-- Logs begin at Thu 2021-05-27 08:48:17 UTC, end at Thu 2021-05-27 09:45:45 UTC. --
May 27 09:18:51.946073 dv-cinder-772623-6-iscsi systemd[1]: Started Devstack devstack@q-svc.service.
May 27 09:18:52.973742 dv-cinder-772623-6-iscsi neutron-server[91715]: Beware of the coming changes in the project packaging
May 27 09:18:52.974333 dv-cinder-772623-6-iscsi neutron-server[91715]: https://github.com/svinota/pyroute2/discussions/786
May 27 09:18:54.492013 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.common.config [-] Logging enabled!
May 27 09:18:54.492671 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev242
May 27 09:18:54.492783 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91715) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 27 09:18:54.495940 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.common.config [-] Logging enabled!
May 27 09:18:54.496196 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev242
May 27 09:18:54.496501 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91715) setup_logging /opt/stack/neutron/neutron/common/config.py:112}}
May 27 09:18:54.497434 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 27 09:18:54.497663 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 27 09:18:54.498022 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 27 09:18:54.498266 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 27 09:18:54.498489 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 27 09:18:54.498805 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] allow_bulk                     = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.499102 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] allow_overlapping_ips          = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.499418 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] api_extensions_path            =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.499647 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] api_paste_config               = api-paste.ini {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.499944 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] api_workers                    = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.500224 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] auth_strategy                  = keystone {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.500500 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] backlog                        = 4096 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.500783 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.501071 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] bind_host                      = 0.0.0.0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.501351 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] bind_port                      = 9696 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.501623 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] client_socket_timeout          = 900 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.501907 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] config_dir                     = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.502131 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.502408 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] config_source                  = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.502686 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] control_exchange               = neutron {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.502967 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] core_plugin                    = ml2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.503187 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] debug                          = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.503487 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] default_availability_zones     = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.503907 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.504301 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] dhcp_agent_notification        = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.504581 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] dhcp_lease_duration            = 86400 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.504861 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] dns_domain                     = openstacklocal {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.505137 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] enable_traditional_dhcp        = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.505404 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] external_dns_driver            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.505678 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] filter_validation              = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.505960 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] global_physnet_mtu             = 1500 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.506280 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] host                           = dv-cinder-772623-6-iscsi {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.506582 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] http_retries                   = 3 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.506847 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] instance_format                = [instance: %(uuid)s]  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.507128 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.507428 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ipam_driver                    = internal {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.507702 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ipv6_pd_enabled                = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.507973 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] log_config_append              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.508254 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.508520 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] log_dir                        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.508785 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] log_file                       = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.509054 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] log_rotate_interval            = 1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.509336 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] log_rotate_interval_type       = days {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.509619 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] log_rotation_type              = none {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.509908 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.510128 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.510347 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.510629 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.511044 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.511179 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] max_dns_nameservers            = 5 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.511478 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] max_header_line                = 16384 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.511748 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] max_logfile_count              = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.512019 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] max_logfile_size_mb            = 200 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.512284 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] max_subnet_host_routes         = 20 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.512546 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] network_link_prefix            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.512827 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.513109 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.513389 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] pagination_max_limit           = -1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.513658 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] periodic_fuzzy_delay           = 5 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.513926 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] periodic_interval              = 40 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.514196 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] publish_errors                 = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.514461 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] rate_limit_burst               = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.514739 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] rate_limit_except_level        = CRITICAL {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.515006 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] rate_limit_interval            = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.515273 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] retry_until_window             = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.515566 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] rpc_response_max_timeout       = 600 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.515854 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] rpc_state_report_workers       = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.516119 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] rpc_workers                    = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.516386 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] send_events_interval           = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.516680 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.516961 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] setproctitle                   = on {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.517239 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] state_path                     = /opt/stack/data/neutron {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.517520 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] syslog_log_facility            = LOG_USER {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.517789 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] tcp_keepidle                   = 600 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.518066 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] transport_url                  = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.518335 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] use_eventlog                   = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.518606 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] use_journal                    = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.518877 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] use_json                       = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.519147 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] use_ssl                        = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.519442 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] use_stderr                     = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.519724 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] use_syslog                     = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.519995 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] vlan_transparent               = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.520264 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] watch_log_file                 = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.520530 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] wsgi_default_pool_size         = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.520801 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] wsgi_keep_alive                = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.521082 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:54.521376 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.521667 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.521981 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] profiler.connection_string     = messaging:// {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.522813 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] profiler.enabled               = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.523058 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] profiler.es_doc_type           = notification {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.523436 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] profiler.es_scroll_size        = 10000 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.523730 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] profiler.es_scroll_time        = 2m {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.524012 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] profiler.filter_error_trace    = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.524301 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.524590 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.524877 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] profiler.socket_timeout        = 0.1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.525155 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.525445 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.525722 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.526018 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.526323 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.526612 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.526899 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.527171 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.527470 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.527743 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.528020 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.528302 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.auth_section              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.528587 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.auth_type                 = password {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.528872 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.529141 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.certfile                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.529416 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.collect_timing            = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.529704 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.endpoint_type             = public {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.529980 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.insecure                  = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.530250 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.keyfile                   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.530524 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.live_migration_events     = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.530807 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.region_name               = RegionOne {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.531079 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.split_loggers             = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.531347 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] nova.timeout                   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.531646 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] placement.auth_section         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.531919 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] placement.auth_type            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.532186 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] placement.cafile               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.532454 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] placement.certfile             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.532728 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] placement.collect_timing       = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.533011 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] placement.endpoint_type        = public {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.533287 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] placement.insecure             = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.533555 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] placement.keyfile              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.533821 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] placement.region_name          = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.534096 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] placement.split_loggers        = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.534360 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] placement.timeout              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.534642 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.auth_section            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.534914 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.auth_type               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.535183 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.cafile                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.535482 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.certfile                = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.535769 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.collect_timing          = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.536038 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.connect_retries         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.536305 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.connect_retry_delay     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.536580 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.enable_notifications    = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.536848 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.endpoint_override       = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.537123 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.insecure                = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.537392 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.interface               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.537716 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.keyfile                 = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.538656 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.max_version             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.538939 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.min_version             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.539205 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.region_name             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.539499 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.service_name            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.539774 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.service_type            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.540051 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.split_loggers           = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.540320 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.status_code_retries     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.540588 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.540857 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.timeout                 = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.541127 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.valid_interfaces        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.541398 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ironic.version                 = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.541686 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.541987 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.542267 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.542545 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.542820 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.543099 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.543401 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.543681 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.543958 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.544233 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.544506 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.544793 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.545071 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.545351 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.545632 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.545911 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.546203 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.546479 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.546757 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.547030 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.547303 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.547614 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.547900 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.548194 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.548486 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.548778 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.549069 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.549358 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.549637 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.549945 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.550222 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:54.550439 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 27 09:18:54.550683 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=91715) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}}
May 27 09:18:54.905534 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=91715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:18:54.905736 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=91715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:18:54.906001 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=91715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:18:54.906486 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.manager [-] Loading core plugin: ml2
May 27 09:18:55.294698 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.294990 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.295261 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.296457 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.296732 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.296994 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.332566 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.332846 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.333114 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.346930 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.347207 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.347497 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.377970 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.378246 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.378513 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.417951 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.418229 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.418529 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.652571 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f2eee6d4f70> agent after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.653205 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x7f2eee6d4f70> agent after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.653205 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x7f2eee6d4ee0> segment precommit_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.653380 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x7f2eee6d4e50> network precommit_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.653998 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x7f2eee6f0a60> segment before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.780311 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> network before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.780629 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x7f2eee6281f0> agent before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.780910 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_net of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> network before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.781184 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> port before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.781450 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler_port of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> port before_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.781753 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> segment precommit_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.782010 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> segment precommit_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.782263 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> segment after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.782515 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> segment after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.782797 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> network after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.783049 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> network precommit_delete 0 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.783308 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> port provisioning_complete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.783591 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> rbac-policy before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.783842 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> rbac-policy after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.784110 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> agent after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.784376 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> subnet after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.785787 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> subnet precommit_delete 0 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.786071 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> rbac-policy before_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.786338 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> rbac-policy before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.786627 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> segment_host_mapping after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.786981 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> port after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.787269 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> port after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.787550 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> port after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.788393 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> rbac-policy before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.788685 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> rbac-policy before_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.788935 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x7f2eeeecaee0>> rbac-policy before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.789324 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=91715) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 27 09:18:55.789565 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=91715) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 27 09:18:55.789801 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=91715) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 27 09:18:55.790040 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=91715) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 27 09:18:55.790274 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=91715) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 27 09:18:55.790508 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=91715) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 27 09:18:55.790885 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve']
May 27 09:18:55.794061 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1']
May 27 09:18:55.797924 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
May 27 09:18:55.801675 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(350, 399)])])
May 27 09:18:55.803345 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']
May 27 09:18:55.804306 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'])
May 27 09:18:55.804648 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan']
May 27 09:18:55.805030 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security']
May 27 09:18:55.807979 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security']
May 27 09:18:55.808230 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security']
May 27 09:18:55.808575 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv']
May 27 09:18:55.835569 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa']
May 27 09:18:55.836019 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.openvswitch.driver.OVSDriver object at 0x7f2eee6519d0>> qos_plugin after_init 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.836320 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=91715) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}}
May 27 09:18:55.836678 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.openvswitch.driver.OVSDriver object at 0x7f2eee651610>> logging-plugin after_init 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.838020 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=91715) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}}
May 27 09:18:55.838303 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv']
May 27 09:18:55.838546 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv']
May 27 09:18:55.842050 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f2eee3f4130>> floatingip before_response 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.842331 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x7f2eee3f4130>> port before_response 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:55.910562 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
May 27 09:18:55.910806 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
May 27 09:18:55.911044 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
May 27 09:18:55.911458 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)]
May 27 09:18:55.942370 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_db.sqlalchemy.engines [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
May 27 09:18:56.273484 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Initializing driver for type 'gre'
May 27 09:18:56.273948 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] gre ID ranges: [(1, 1000)]
May 27 09:18:56.336993 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Initializing driver for type 'local'
May 27 09:18:56.337332 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Initializing driver for type 'vlan'
May 27 09:18:56.349268 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] VlanTypeDriver initialization complete
May 27 09:18:56.349636 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Initializing driver for type 'vxlan'
May 27 09:18:56.350663 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] vxlan ID ranges: [(1, 1000)]
May 27 09:18:56.403682 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Initializing extension driver 'port_security'
May 27 09:18:56.404034 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.extensions.port_security [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] PortSecurityExtensionDriver initialization complete
May 27 09:18:56.404374 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Initializing mechanism driver 'openvswitch'
May 27 09:18:56.404706 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Initializing mechanism driver 'hyperv'
May 27 09:18:56.411702 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.plugins.ml2.plugin [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=91715) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:18:56.412514 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eee4bf700>> port after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.414772 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eee4bf700>> port after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.414772 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eee4bf700>> port after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.414772 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eee4bf8b0>> subnet after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.415015 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eee4bf8b0>> subnet after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.415253 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eee4bf8b0>> subnet after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.415670 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43520>> network after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.416088 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43520>> network after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.416376 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_payload_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43520>> network after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.416759 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43790>> security_group after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.417117 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43790>> security_group after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.417463 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43790>> security_group after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.417846 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43a00>> security_group_rule after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.418194 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43a00>> security_group_rule after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.418537 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43a00>> security_group_rule after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.418918 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43c70>> address_group after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.419265 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43c70>> address_group after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.419630 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x7f2eedf43c70>> address_group after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.419973 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] ML2 OVO RPC backend initialized. {{(pid=91715) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}}
May 27 09:18:56.420713 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_created of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> router_interface after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.421074 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._after_router_interface_deleted of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> router_interface after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.421499 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> network before_response 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.421850 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> networks before_response 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.422203 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> port before_response 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.422548 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> ports before_response 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.422896 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> subnet before_response 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.423239 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> subnets before_response 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.423618 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> network after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.423968 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> network after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.424307 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> network after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.424651 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> port after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.425001 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> port after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.425341 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> port after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.425682 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> subnet after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.426026 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> subnet after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.426364 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DhcpAgentNotifyAPI._native_event_send_dhcp_notification of <neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI object at 0x7f2eedf43fd0>> subnet after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.426960 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.plugin [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Modular L2 Plugin initialization complete
May 27 09:18:56.427294 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading services supported by the core plugin {{(pid=91715) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}}
May 27 09:18:56.427656 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.plugins.ml2.managers [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Got port-security extension from driver 'port_security'
May 27 09:18:56.428129 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.extensions.vlantransparent [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Disabled vlantransparent extension.
May 27 09:18:56.429398 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=91715) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
May 27 09:18:56.429905 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading Plugin: router
May 27 09:18:56.467754 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._add_csnat_on_interface_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router_interface before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.468152 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method L3_HA_NAT_db_mixin._after_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router after_create 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.468532 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method L3_HA_NAT_db_mixin._before_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router before_create 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.468903 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router_interface before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.469283 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._cleanup_after_interface_removal of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router_interface after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.469912 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method L3_HA_NAT_db_mixin._cleanup_ha_network of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router after_delete 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.470273 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._create_dvr_floating_gw_port of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> floatingip after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.470638 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router after_create 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.470988 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._create_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router after_update 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.471342 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._delete_distributed_port_bindings_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router after_update 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.471723 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._delete_dvr_internal_ports of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router_gateway after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.472085 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._delete_snat_interfaces_after_change of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router after_update 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.472496 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._handle_distributed_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router precommit_update 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.472868 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x7f2eee5698b0> port after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.473211 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x7f2eee569a60> port after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.473552 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x7f2eee5699d0> subnet after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.473901 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x7f2eee569940> subnetpool_address_scope after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.474257 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> port precommit_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.474611 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method L3_HA_NAT_db_mixin._precommit_router_create of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router precommit_create 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.474957 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x7f2eee55e4c0> port before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.476024 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router precommit_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.476608 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method L3_HA_NAT_db_mixin._reconfigure_ha_resources of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router after_update 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.476969 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method L3_HA_NAT_db_mixin._release_router_vr_id of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router precommit_delete 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.477327 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._set_distributed_flag of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router precommit_create 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.477697 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router_interface after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.478047 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method L3_HA_NAT_db_mixin._validate_migration of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> router precommit_update 55549900 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.478429 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net of <neutron.services.l3_router.l3_router_plugin.L3RouterPlugin object at 0x7f2eedf501c0>> network after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.479283 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Tracking information for resource: router configured {{(pid=91715) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 27 09:18:56.479640 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Tracking information for resource: floatingip configured {{(pid=91715) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}}
May 27 09:18:56.484562 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.db.l3_agentschedulers_db [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Skipping period L3 agent status check because automatic router rescheduling is disabled.
May 27 09:18:56.485152 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <function _notify_l3_agent_port_update at 0x7f2eedec5e50> port after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.485520 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <function _notify_l3_agent_new_port at 0x7f2eedec5d30> port after_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.485883 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <function _notify_port_delete at 0x7f2eedec5dc0> port after_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.486240 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <function _notify_l3_agent_ha_port_update at 0x7f2eedec8160> port after_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.487040 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f2eedee49a0>> router before_create 55550100 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.487445 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f2eedee49a0>> router precommit_delete 55550100 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.487812 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f2eedee49a0>> router precommit_create 55550100 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.488170 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.l3_router.service_providers.driver_controller.DriverController object at 0x7f2eedee49a0>> router precommit_update 55550100 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.493711 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.services.provider_configuration [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service providers = [] {{(pid=91715) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
May 27 09:18:56.494085 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.db.servicetype_db [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=91715) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
May 27 09:18:56.497058 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.services.service_base [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=91715) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 27 09:18:56.497420 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.services.service_base [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=91715) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 27 09:18:56.497768 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.services.service_base [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=91715) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 27 09:18:56.498657 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.services.service_base [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=91715) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
May 27 09:18:56.499035 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.services.service_base [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Default provider is not specified for service type L3_ROUTER_NAT
May 27 09:18:56.499611 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=91715) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 27 09:18:56.499941 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin
May 27 09:18:56.510652 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Successfully loaded METERING plugin. Description: METERING {{(pid=91715) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 27 09:18:56.510992 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading Plugin: auto_allocate
May 27 09:18:56.516749 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f2eedf144c0> network precommit_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.517121 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x7f2eedf144c0> network precommit_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.517642 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=91715) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 27 09:18:56.517965 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading Plugin: tag
May 27 09:18:56.525083 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=91715) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 27 09:18:56.525377 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading Plugin: timestamp
May 27 09:18:56.529145 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=91715) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 27 09:18:56.529484 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading Plugin: network_ip_availability
May 27 09:18:56.534710 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f2eedf04eb0>> rbac-policy before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.535086 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f2eedf04eb0>> rbac-policy before_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.535477 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f2eedf04eb0>> rbac-policy before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.536191 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=91715) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 27 09:18:56.536519 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading Plugin: flavors
May 27 09:18:56.542216 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=91715) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 27 09:18:56.542559 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading Plugin: revisions
May 27 09:18:56.546806 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=91715) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
May 27 09:18:56.547205 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_concurrency.lockutils [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.641s {{(pid=91715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:18:56.547986 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=91715) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}}
May 27 09:18:56.548328 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Initializing extension manager.
May 27 09:18:56.548834 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: __init__.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.549176 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: __pycache__ {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.549510 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.549845 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: address_group.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.550600 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.551171 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: address-group
May 27 09:18:56.551539 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: address_scope.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.552264 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.552774 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: address-scope
May 27 09:18:56.553100 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: admin_state_down_before_update.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.554829 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.555347 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: router-admin-state-down-before-update
May 27 09:18:56.555710 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: agent.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.556417 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.556932 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: agent
May 27 09:18:56.557261 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: agent_resources_synced.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.558168 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.558679 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: agent-resources-synced
May 27 09:18:56.559008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: allowedaddresspairs.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.560814 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.561344 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: allowed-address-pairs
May 27 09:18:56.561676 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: auto_allocated_topology.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.562759 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.563290 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: auto-allocated-topology
May 27 09:18:56.563636 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: availability_zone.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.564329 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.564839 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: availability_zone
May 27 09:18:56.565168 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: availability_zone_filter.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.566072 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.566584 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: availability_zone_filter
May 27 09:18:56.566911 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: data_plane_status.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.567838 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.568351 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension data-plane-status not supported by any of loaded plugins
May 27 09:18:56.568673 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: default_subnetpools.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.569872 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.570396 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: default-subnetpools
May 27 09:18:56.570726 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: dhcpagentscheduler.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.571571 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.572091 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: dhcp_agent_scheduler
May 27 09:18:56.572416 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: dns.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.573330 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.573847 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension dns-integration not supported by any of loaded plugins
May 27 09:18:56.574173 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: dns_domain_ports.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.575081 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.575628 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension dns-domain-ports not supported by any of loaded plugins
May 27 09:18:56.575954 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: dvr.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.576621 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.577131 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: dvr
May 27 09:18:56.577452 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: empty_string_filtering.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.578374 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.578938 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: empty-string-filtering
May 27 09:18:56.579206 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.580142 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.580650 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
May 27 09:18:56.580975 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.581899 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.582405 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
May 27 09:18:56.582730 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: external_net.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.583664 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.584179 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: external-net
May 27 09:18:56.584526 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: extra_dhcp_opt.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.585677 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.586192 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: extra_dhcp_opt
May 27 09:18:56.586520 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: extraroute.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.587465 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.587979 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: extraroute
May 27 09:18:56.588305 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: extraroute_atomic.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.589587 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.590096 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: extraroute-atomic
May 27 09:18:56.590422 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: filter_validation.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.591089 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.591626 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: filter-validation
May 27 09:18:56.591958 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: fip_pf_description.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.593045 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.593562 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
May 27 09:18:56.593890 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: fip_port_details.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.594810 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.595326 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: fip-port-details
May 27 09:18:56.595687 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: flavors.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.596921 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.597439 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: flavors
May 27 09:18:56.597772 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.599459 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.599984 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
May 27 09:18:56.600969 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: floatingip_pools.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.601886 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.602416 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: floatingip-pools
May 27 09:18:56.602745 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: ip_allocation.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.603698 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.604215 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension ip_allocation not supported by any of loaded plugins
May 27 09:18:56.604543 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: ip_substring_port_filtering.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.605463 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.605980 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: ip-substring-filtering
May 27 09:18:56.606308 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: l2_adjacency.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.607237 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.607787 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension l2_adjacency not supported by any of loaded plugins
May 27 09:18:56.608112 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: l3.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.609095 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.609617 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: router
May 27 09:18:56.609946 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: l3_conntrack_helper.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.612228 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.612773 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension l3-conntrack-helper not supported by any of loaded plugins
May 27 09:18:56.613113 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: l3_ext_gw_mode.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.614044 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.614570 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: ext-gw-mode
May 27 09:18:56.614902 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: l3_ext_ha_mode.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.616424 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.617243 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: l3-ha
May 27 09:18:56.617575 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: l3_flavors.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.618515 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.619043 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: l3-flavors
May 27 09:18:56.619387 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.620316 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.620831 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: l3-port-ip-change-not-allowed
May 27 09:18:56.621157 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: l3agentscheduler.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.622214 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.622894 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: l3_agent_scheduler
May 27 09:18:56.623074 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: logging.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.624637 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.625174 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension logging not supported by any of loaded plugins
May 27 09:18:56.625514 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: metering.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.626277 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.626862 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: metering
May 27 09:18:56.627195 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.628325 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.628846 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: metering_source_and_destination_fields
May 27 09:18:56.629177 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: multiprovidernet.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.630248 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.630764 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: multi-provider
May 27 09:18:56.631099 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: netmtu.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.632877 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.633411 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: net-mtu
May 27 09:18:56.633740 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: netmtu_writable.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.634665 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.635183 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: net-mtu-writable
May 27 09:18:56.635549 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: network_availability_zone.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.636225 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.636740 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: network_availability_zone
May 27 09:18:56.637068 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: network_ip_availability.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.638167 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.638686 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: network-ip-availability
May 27 09:18:56.639015 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: network_segment_range.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.639839 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.640344 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension network-segment-range not supported by any of loaded plugins
May 27 09:18:56.640669 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: pagination.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.641638 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.641974 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: pagination
May 27 09:18:56.642298 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: port_device_profile.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.643216 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.643764 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: port-device-profile
May 27 09:18:56.644092 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: port_mac_address_regenerate.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.644996 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.645508 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: port-mac-address-regenerate
May 27 09:18:56.645832 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: port_numa_affinity_policy.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.646728 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.648028 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: port-numa-affinity-policy
May 27 09:18:56.648452 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: port_resource_request.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.649359 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.649875 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension port-resource-request not supported by any of loaded plugins
May 27 09:18:56.650201 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: portbindings.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.651129 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.651682 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: binding
May 27 09:18:56.652017 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: portbindings_extended.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.653312 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.653849 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: binding-extended
May 27 09:18:56.654150 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: portsecurity.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.655069 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.655625 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: port-security
May 27 09:18:56.655959 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: project_id.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.656929 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.657260 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: project-id
May 27 09:18:56.657585 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: providernet.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.658499 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.659015 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: provider
May 27 09:18:56.659341 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: qos.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.663157 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.663812 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension qos not supported by any of loaded plugins
May 27 09:18:56.664149 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: qos_bw_limit_direction.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.665398 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.665916 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
May 27 09:18:56.666251 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.667207 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.667753 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
May 27 09:18:56.668088 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: qos_default.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.669008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.669526 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension qos-default not supported by any of loaded plugins
May 27 09:18:56.669856 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: qos_fip.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.670520 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.671027 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension qos-fip not supported by any of loaded plugins
May 27 09:18:56.671391 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: qos_gateway_ip.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.672293 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.672813 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension qos-gateway-ip not supported by any of loaded plugins
May 27 09:18:56.673136 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: qos_port_network_policy.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.674046 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.674559 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension qos-port-network-policy not supported by any of loaded plugins
May 27 09:18:56.674884 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: qos_rule_type_details.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.675823 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.676332 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension qos-rule-type-details not supported by any of loaded plugins
May 27 09:18:56.676655 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: qos_rules_alias.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.677696 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.678212 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension qos-rules-alias not supported by any of loaded plugins
May 27 09:18:56.679183 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: quotasv2.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.680519 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.680854 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: quotas
May 27 09:18:56.681181 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: quotasv2_detail.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.682828 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.683186 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: quota_details
May 27 09:18:56.683562 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: rbac.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.684637 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.685171 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: rbac-policies
May 27 09:18:56.685506 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: rbac_address_group.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.686431 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.686954 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: rbac-address-group
May 27 09:18:56.687283 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: rbac_address_scope.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.688231 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.688749 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: rbac-address-scope
May 27 09:18:56.689077 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: rbac_security_groups.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.689980 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.690496 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: rbac-security-groups
May 27 09:18:56.690823 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: rbac_subnetpool.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.691777 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.692299 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: rbac-subnetpool
May 27 09:18:56.692625 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: revisionifmatch.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.693553 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.694666 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: revision-if-match
May 27 09:18:56.695319 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: revisions.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.696412 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.696935 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: standard-attr-revisions
May 27 09:18:56.697270 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: router_availability_zone.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.697949 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.698468 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: router_availability_zone
May 27 09:18:56.698797 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: routerservicetype.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.699758 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.700281 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension router-service-type not supported by any of loaded plugins
May 27 09:18:56.700610 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.701528 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.702044 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: security-groups-normalized-cidr
May 27 09:18:56.702371 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: security_groups_port_filtering.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.703293 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.703842 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: port-security-groups-filtering
May 27 09:18:56.704172 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: security_groups_remote_address_group.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.705084 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.705599 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: security-groups-remote-address-group
May 27 09:18:56.705923 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: securitygroup.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.716212 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.716746 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: security-group
May 27 09:18:56.717086 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: segment.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.717874 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.718389 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension segment not supported by any of loaded plugins
May 27 09:18:56.718722 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.719702 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.720217 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
May 27 09:18:56.720547 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: servicetype.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.721662 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.722182 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: service-type
May 27 09:18:56.722511 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: sorting.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.723528 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.723868 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: sorting
May 27 09:18:56.724196 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: standard_attr_segment.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.725148 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.725930 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension standard-attr-segment not supported by any of loaded plugins
May 27 09:18:56.726266 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: standardattrdescription.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.726917 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.727464 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: standard-attr-description
May 27 09:18:56.727795 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: stateful_security_group.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.728711 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.729227 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: stateful-security-group
May 27 09:18:56.729555 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: stdattrs_common.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.730132 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
May 27 09:18:56.730477 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.731480 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.731999 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins
May 27 09:18:56.732327 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: subnet_onboard.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.733450 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.733975 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: subnet_onboard
May 27 09:18:56.734304 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: subnet_segmentid_writable.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.735231 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.735786 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
May 27 09:18:56.736115 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: subnet_service_types.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.737041 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.737614 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: subnet-service-types
May 27 09:18:56.737943 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: subnetallocation.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.739108 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.739668 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: subnet_allocation
May 27 09:18:56.740000 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.740671 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.742040 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: subnetpool-prefix-ops
May 27 09:18:56.742436 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.743396 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.743917 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
May 27 09:18:56.744245 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: tagging.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.745361 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.745888 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: standard-attr-tag
May 27 09:18:56.746219 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: timestamp.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.747448 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.747970 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loaded extension: standard-attr-timestamp
May 27 09:18:56.748300 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: trunk.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.749327 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.749848 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension trunk not supported by any of loaded plugins
May 27 09:18:56.750180 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: trunk_details.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.751090 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.751631 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension trunk-details not supported by any of loaded plugins
May 27 09:18:56.751959 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: uplink_status_propagation.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.752872 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.753388 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension uplink-status-propagation not supported by any of loaded plugins
May 27 09:18:56.753722 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Loading extension file: vlantransparent.py {{(pid=91715) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}}
May 27 09:18:56.754392 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=91715) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}}
May 27 09:18:56.754902 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extension vlan-transparent not supported by any of loaded plugins
May 27 09:18:56.757826 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:network
May 27 09:18:56.758582 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:subnet
May 27 09:18:56.760510 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:subnetpool
May 27 09:18:56.761138 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:port
May 27 09:18:56.762432 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.762874 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service FLAVORS assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.763519 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.763969 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.764304 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:router
May 27 09:18:56.764963 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:floatingip
May 27 09:18:56.765680 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service METERING assigned prefix: /metering {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.767095 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f2eedde7550>> rbac-policy before_create 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.767501 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f2eedde7550>> rbac-policy before_update 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.767856 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x7f2eedde7550>> rbac-policy before_delete 55550000 {{(pid=91715) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:18:56.769012 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of CountableResource for resource:rbac_policy
May 27 09:18:56.769464 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:security_group
May 27 09:18:56.770133 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:security_group_rule
May 27 09:18:56.771294 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service CORE assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.771620 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:subnetpool
May 27 09:18:56.772640 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] subnetpool is already registered
May 27 09:18:56.773587 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service CORE assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.773974 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:subnetpool
May 27 09:18:56.774420 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] subnetpool is already registered
May 27 09:18:56.778609 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.779005 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service FLAVORS assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.779689 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.780195 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service L3_ROUTER_NAT assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.780501 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:router
May 27 09:18:56.780877 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] router is already registered
May 27 09:18:56.781566 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:floatingip
May 27 09:18:56.781902 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] floatingip is already registered
May 27 09:18:56.782698 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service METERING assigned prefix: /metering {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.783419 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of CountableResource for resource:rbac_policy
May 27 09:18:56.783852 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] rbac_policy is already registered
May 27 09:18:56.784523 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:security_group
May 27 09:18:56.785042 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] security_group is already registered
May 27 09:18:56.785728 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:security_group_rule
May 27 09:18:56.786160 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] security_group_rule is already registered
May 27 09:18:56.786901 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service CORE assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.787386 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:subnetpool
May 27 09:18:56.788415 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] subnetpool is already registered
May 27 09:18:56.789300 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.v2.resource_helper [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Service CORE assigned prefix:  {{(pid=91715) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}}
May 27 09:18:56.789637 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Creating instance of TrackedResource for resource:subnetpool
May 27 09:18:56.790037 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING neutron.quota.resource_registry [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] subnetpool is already registered
May 27 09:18:56.790820 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: extensions {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.793036 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: address-groups {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.794659 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: address-scopes {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.795922 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: agents {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.797083 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: auto-allocated-topology {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.798338 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: availability_zones {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.799672 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: dhcp-networks {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.801090 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: dhcp-agents {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.802507 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: routers {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.804835 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: flavors {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.806000 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: service_profiles {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.807224 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: next_providers {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.808769 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: service_profiles {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.810209 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: floatingip-pools {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.811444 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: routers {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.813261 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: floatingips {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.814441 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: l3-routers {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.815860 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: l3-agents {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.817253 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: metering-labels {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.818598 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: metering-label-rules {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.820311 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: network-ip-availabilities {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.821576 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: bindings {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.823224 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: quotas {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.824713 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: quotas {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.826125 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: rbac-policies {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.827754 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: security-groups {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.828966 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: security-group-rules {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.830187 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: service-providers {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.831449 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: subnetpools {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.833842 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: subnetpools {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.836201 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: tags {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.837919 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: tags {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.968843 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: tags {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.970632 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: tags {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.972505 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: tags {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.974416 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: tags {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.976666 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: tags {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.978599 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: tags {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.980400 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: tags {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.982306 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron.api.extensions [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Extended resource: tags {{(pid=91715) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}}
May 27 09:18:56.988368 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING keystonemiddleware.auth_token [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True.
May 27 09:18:56.994389 dv-cinder-772623-6-iscsi neutron-server[91715]: WARNING keystonemiddleware.auth_token [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
May 27 09:18:57.003174 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_concurrency.lockutils [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Acquired lock "singleton_lock" {{(pid=91715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}}
May 27 09:18:57.003688 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_concurrency.lockutils [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Releasing lock "singleton_lock" {{(pid=91715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}}
May 27 09:18:57.004357 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO oslo_service.service [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Starting 2 workers
May 27 09:18:57.009977 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Started child 91820 {{(pid=91715) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 27 09:18:57.014628 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Started child 91821 {{(pid=91715) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 27 09:18:57.014975 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:18:57.016300 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO neutron.service [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Neutron service started, listening on 0.0.0.0:9696
May 27 09:18:57.016528 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [-] (91820) wsgi starting up on http://0.0.0.0:9696
May 27 09:18:57.016934 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Notify callbacks [] for process, before_spawn {{(pid=91715) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:18:57.019156 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:18:57.019640 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO oslo_service.service [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Starting 1 workers
May 27 09:18:57.020601 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [-] (91821) wsgi starting up on http://0.0.0.0:9696
May 27 09:18:57.024880 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Started child 91822 {{(pid=91715) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 27 09:18:57.025412 dv-cinder-772623-6-iscsi neutron-server[91715]: INFO oslo_service.service [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Starting 1 workers
May 27 09:18:57.028274 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.service [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] calling RpcWorker wait() {{(pid=91822) _wait /opt/stack/neutron/neutron/service.py:128}}
May 27 09:18:57.029036 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.service [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] returning from RpcWorker wait() {{(pid=91822) _wait /opt/stack/neutron/neutron/service.py:135}}
May 27 09:18:57.029883 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Started child 91823 {{(pid=91715) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}}
May 27 09:18:57.030294 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:18:57.030667 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG neutron_lib.callbacks.manager [None req-32b9e182-a679-4571-b4d2-dc3f7bff411e None None] Notify callbacks [] for process, after_spawn {{(pid=91715) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:18:57.030821 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:18:57.032597 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91715) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 27 09:18:57.032815 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 27 09:18:57.033006 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 27 09:18:57.033226 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 27 09:18:57.033571 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 27 09:18:57.033738 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 27 09:18:57.034243 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.034613 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.034796 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:18:57.035269 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.035269 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.035521 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.035948 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.036213 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.036471 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.036756 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.037015 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.037195 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.037368 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.037657 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.037916 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.038471 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.038887 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.039150 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.039457 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.039642 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.039915 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.040201 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.040436 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.040731 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] debug                          = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.040981 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.041462 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.041697 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.041954 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.042185 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.042467 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.042730 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.043024 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.043278 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.043564 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.043809 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.044077 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.044334 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.044562 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.044789 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.045054 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.045296 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.045804 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] host                           = dv-cinder-772623-6-iscsi {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.046028 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.046271 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.046524 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.046781 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.047059 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.047286 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.047575 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.047828 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.048074 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.048381 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.048554 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.048816 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.049057 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.049312 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.049481 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.049705 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.049999 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.050282 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.050478 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.050656 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.050844 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.051108 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.051277 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.051581 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.051822 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.052046 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.052331 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.052530 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.052751 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.053026 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.053830 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.054208 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.054576 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.055008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.055264 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.055542 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.055798 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.056063 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.056288 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.056513 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.056743 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.056994 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.057240 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.057462 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.057710 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.057936 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.058204 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.058486 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.058723 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.058960 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.059180 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.059430 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.059701 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.059939 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.060142 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:18:57.060297 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.060438 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.060645 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.060898 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.061118 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.061362 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.061610 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.061854 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.062073 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.062348 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.062609 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.062803 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.063343 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.063343 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.063819 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.063963 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.064208 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.064507 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.064726 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.065014 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.065269 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.065510 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.065762 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.066583 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.066583 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.066583 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.067554 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.067554 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.067554 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.068464 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.068464 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.068464 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.068464 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.069546 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.069546 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.069763 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.070050 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.071415 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.071415 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.071415 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.30/identity {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.071672 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.071672 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.071925 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.072162 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.072387 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.072625 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.072875 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.073151 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.073390 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.073614 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.073904 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.074623 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.074623 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.074623 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.074872 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.075066 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.075304 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.075561 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.075786 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.076026 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.076244 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.076483 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.076723 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.077141 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.077597 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.078003 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.078413 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.078867 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.079303 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.079777 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.080166 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.080550 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.080929 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.081299 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.081677 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.081938 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.082381 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.082818 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.083218 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.083646 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.084047 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.084466 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.085012 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.085655 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.086062 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.086458 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.086965 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.087492 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.087966 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.088388 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.088843 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.089408 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.089726 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.090048 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.090337 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.090626 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.090930 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.091213 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.091536 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.091943 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.092255 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.092546 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.092867 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.093189 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.093511 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.093812 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.094293 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.094736 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.095196 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.095644 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.096143 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.096605 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.097074 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.097545 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.097968 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.098446 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.098889 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.099338 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.099825 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.100726 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.101156 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.101866 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.102159 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.102737 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.103081 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.103462 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.103830 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.104163 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.104614 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.104853 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.105134 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.105434 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.105729 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.106018 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.106279 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.106534 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.107022 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.107498 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.107909 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.108295 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.108716 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.108983 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.109261 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.109518 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.109769 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.109991 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.110228 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.110561 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.110816 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.111041 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.111261 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.111561 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.111808 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.112054 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.112332 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.112592 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.112838 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.113099 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.113359 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.30/identity {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.113602 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.113818 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.114053 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.114431 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.114687 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.114925 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.115168 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.115431 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.115654 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.116588 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.116930 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.117361 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.117671 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.117907 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.118137 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.118394 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.118613 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.118838 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.119084 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.119309 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.119560 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.119784 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.120007 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.120263 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.120487 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.120774 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.121032 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.121273 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.121508 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.121758 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.122016 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.122234 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.122487 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.122707 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.122943 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.123161 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.123415 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.123656 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.123894 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.124145 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.124364 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.124607 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.124826 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.125154 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.125415 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.125644 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.125893 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.126116 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.126381 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.126622 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.126841 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.127060 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.127277 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.127523 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.127787 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.128029 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.128282 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.128496 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.128707 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.128919 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.129136 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.129349 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.129643 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.129912 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.130148 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.130396 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.130629 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.135393 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.135393 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.135393 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.135872 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 45160) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:18:57.136008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.136008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.136008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.136008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.136008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.136008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.136008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.136008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.136008 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137049 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137049 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137049 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137049 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137049 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137049 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137049 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137049 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137988 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137988 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137988 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137988 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137988 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137988 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137988 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.137988 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.138894 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.138894 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.138894 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.138894 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.138894 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.138894 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.139621 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.139621 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.139621 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.139981 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.140103 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.140456 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:350:399'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.140651 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.140869 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.141165 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.141511 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.141800 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.142063 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.142320 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.142610 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.142832 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.143084 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.143311 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.143579 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.143799 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.144060 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.144294 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.144523 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.144744 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.144974 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.145191 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.145417 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.145652 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.145896 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.146113 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.146272 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 27 09:18:57.146866 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91715) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}}
May 27 09:18:57.147060 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
May 27 09:18:57.147220 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
May 27 09:18:57.147496 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
May 27 09:18:57.148299 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
May 27 09:18:57.148299 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
May 27 09:18:57.148559 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] agent_down_time                = 75 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.148682 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [-] 10.222.0.30 "GET / HTTP/1.1" status: 200  len: 253 time: 0.0145679
May 27 09:18:57.148812 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover  = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.148954 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.150121 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] allow_bulk                     = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.150297 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] allow_overlapping_ips          = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.150533 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.150708 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] api_extensions_path            =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.151586 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] api_paste_config               = api-paste.ini {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.151780 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] api_workers                    = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.151971 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] auth_strategy                  = keystone {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.152130 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] backdoor_port                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.152322 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] backdoor_socket                = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.152478 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] backlog                        = 4096 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.152649 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.152843 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] bind_host                      = 0.0.0.0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.153006 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] bind_port                      = 9696 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.153151 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] client_socket_timeout          = 900 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.153321 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] config_dir                     = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.153493 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.153646 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] config_source                  = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.153802 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] control_exchange               = neutron {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.153961 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] core_plugin                    = ml2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.154214 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] debug                          = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.154312 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] default_availability_zones     = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.154453 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.154618 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dhcp_agent_notification        = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.154777 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dhcp_agents_per_network        = 1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.155396 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dhcp_lease_duration            = 86400 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.155396 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dhcp_load_type                 = networks {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.155396 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dns_domain                     = openstacklocal {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.155396 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.155696 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] enable_dvr                     = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.155696 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] enable_new_agents              = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.156085 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.156236 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] enable_snat_by_default         = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.156581 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] enable_traditional_dhcp        = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.156581 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] external_dns_driver            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.156733 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] filter_validation              = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.156832 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] global_physnet_mtu             = 1500 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.156993 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] graceful_shutdown_timeout      = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.157149 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] host                           = dv-cinder-772623-6-iscsi {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.157303 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] host_dvr_for_dhcp              = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.157458 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] http_retries                   = 3 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.157622 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] instance_format                = [instance: %(uuid)s]  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.158545 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.158545 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ipam_driver                    = internal {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.158545 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ipv6_pd_enabled                = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.158545 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] l3_ha                          = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.158545 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.158882 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:18:57.158956 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] l3_ha_network_physical_name    =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.158956 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] l3_ha_network_type             =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.158956 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_config_append              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.158956 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.159180 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_dir                        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.159246 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_file                       = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.159480 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_options                    = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.159620 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_rotate_interval            = 1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.159858 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_rotate_interval_type       = days {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.160026 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] log_rotation_type              = none {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.160205 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.160371 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.160528 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.160685 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.160843 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] logging_user_identity_format   = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.161000 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_allowed_address_pair       = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.161157 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_dns_nameservers            = 5 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.161313 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_header_line                = 16384 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.161470 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_l3_agents_per_router       = 3 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.161626 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_logfile_count              = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.161783 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_logfile_size_mb            = 200 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.161939 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_routes                     = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.162095 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] max_subnet_host_routes         = 20 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.162251 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] network_auto_schedule          = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.162425 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] network_link_prefix            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.162556 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.163292 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.163428 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.164000 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] pagination_max_limit           = -1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.164000 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] periodic_fuzzy_delay           = 5 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.164000 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] periodic_interval              = 40 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.164330 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] publish_errors                 = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.164444 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rate_limit_burst               = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.164562 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rate_limit_except_level        = CRITICAL {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.164671 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rate_limit_interval            = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.164808 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] retry_until_window             = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.164965 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] router_auto_schedule           = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.165124 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] router_distributed             = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.165336 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] router_scheduler_driver        = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.165460 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rpc_response_max_timeout       = 600 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.165587 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rpc_response_timeout           = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.165745 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rpc_state_report_workers       = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.165901 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] rpc_workers                    = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.166058 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] send_events_interval           = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.166220 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] service_plugins                = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.166378 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] setproctitle                   = on {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.166535 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] state_path                     = /opt/stack/data/neutron {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.166691 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] syslog_log_facility            = LOG_USER {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.166848 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] tcp_keepidle                   = 600 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.167006 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] transport_url                  = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.167164 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_eventlog                   = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.167321 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_journal                    = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.167517 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_json                       = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.167784 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_ssl                        = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.167912 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_stderr                     = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.168019 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] use_syslog                     = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.168128 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] vlan_transparent               = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.168284 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] watch_log_file                 = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.168441 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] wsgi_default_pool_size         = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.168599 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] wsgi_keep_alive                = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.168758 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
May 27 09:18:57.168939 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.169101 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.169275 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.connection_string     = messaging:// {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.169436 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.enabled               = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.169596 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.es_doc_type           = notification {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.169756 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.es_scroll_size        = 10000 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.170020 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.es_scroll_time        = 2m {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.170261 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.filter_error_trace    = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.170402 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.hmac_keys             = SECRET_KEY {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.170511 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.170653 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.socket_timeout        = 0.1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.170814 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.170986 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.171146 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.171305 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.171523 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.171684 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.171844 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.172004 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.172163 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.172322 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.172482 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.172661 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.auth_section              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.172821 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.auth_type                 = password {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.172983 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.auth_url                  = http://10.222.0.30/identity {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.173144 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.cafile                    = /opt/stack/data/ca-bundle.pem {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.173307 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.certfile                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.173468 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.collect_timing            = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.173699 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.default_domain_id         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.173909 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.default_domain_name       = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.174013 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.domain_id                 = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.174114 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.domain_name               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.174265 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.endpoint_type             = public {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.174477 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.insecure                  = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.174562 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.keyfile                   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.174935 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.live_migration_events     = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.174935 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.password                  = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.175105 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.project_domain_id         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.175184 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.project_domain_name       = Default {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.175331 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.project_id                = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.176363 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.project_name              = service {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.176528 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.region_name               = RegionOne {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.176693 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.split_loggers             = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.177197 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.system_scope              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.177197 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.timeout                   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.177197 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.trust_id                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.177538 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.user_domain_id            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.177538 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.user_domain_name          = Default {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.178029 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.user_id                   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.178029 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] nova.username                  = nova {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.179855 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.auth_section         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.179855 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.auth_type            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.179855 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.cafile               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.179855 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.certfile             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.179855 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.collect_timing       = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.179855 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.endpoint_type        = public {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.179855 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.insecure             = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.179855 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.keyfile              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.179855 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.region_name          = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.181502 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.split_loggers        = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.181502 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] placement.timeout              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.181502 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.auth_section            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.181502 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.auth_type               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.181502 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.cafile                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.181502 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.certfile                = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.181502 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.collect_timing          = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.181502 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.connect_retries         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.181502 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.connect_retry_delay     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.183341 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.enable_notifications    = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.183341 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.endpoint_override       = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.183341 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.insecure                = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.183341 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.interface               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.183341 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.keyfile                 = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.183341 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.max_version             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.183341 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.min_version             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.183341 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.region_name             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.183341 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.service_name            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.184694 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.service_type            = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.184694 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.split_loggers           = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.184694 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.status_code_retries     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.184694 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.184694 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.timeout                 = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.184694 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.valid_interfaces        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.184694 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ironic.version                 = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.184694 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.184694 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.185424 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.185424 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.185424 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.185424 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.185424 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.185424 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.185424 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.185424 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.186086 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.186086 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.186086 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.186086 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.186086 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.186086 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.186592 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.186592 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.186592 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.186875 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.186875 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.187070 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.187070 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.187272 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.187400 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.187546 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.187707 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.187902 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.188040 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.188223 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.188364 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.188531 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.188702 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.default_quota           = -1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.188862 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_driver            = neutron.db.quota.driver.DbQuotaDriver {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.189049 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip        = 50 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.189161 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_network           = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.189319 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_port              = 500 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.189479 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.189638 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_router            = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.189806 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group    = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.189954 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.190231 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet            = 100 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.190385 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage       = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.190558 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.190729 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] healthcheck.backends           = ['disable_by_file'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.190912 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] healthcheck.detailed           = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.191226 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.191226 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] healthcheck.path               = /healthcheck {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.191445 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.191529 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.191697 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.191854 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.192171 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.192335 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.192491 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port   = 35357 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.192792 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.193080 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.193376 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type   = password {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.193544 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri    = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.193719 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url    = http://10.222.0.30/identity {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.194432 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.194629 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.cache       = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.194785 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.194934 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.certfile    = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.195252 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.195481 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.195699 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.195869 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.196036 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.196181 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.196345 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.196509 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.196672 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.196835 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.196981 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.insecure    = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.197143 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.interface   = public {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.197423 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.197692 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.197840 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.198069 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.198284 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.198417 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.198542 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.198682 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.199034 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.199627 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.200073 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.password    = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.200359 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.200533 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.200698 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.project_id  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.200903 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.201166 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.201166 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.201621 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.201621 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.202093 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.202093 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.202093 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id    = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.202766 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.202766 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.202766 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.user_id     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.202766 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.username    = neutron {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.203736 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.203736 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.backend                  = dogpile.cache.null {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.203736 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.backend_argument         = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.203736 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.config_prefix            = cache.oslo {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.203736 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.debug_cache_backend      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.204859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.enabled                  = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.204859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.expiration_time          = 600 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.204859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_dead_retry      = 300 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.204859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.204859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.204859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize    = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.204859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.206197 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_servers         = ['localhost:11211'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.206197 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout  = 1.0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.206197 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.proxies                  = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.206197 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers      = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.206197 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.tls_cafile               = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.206197 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.tls_certfile             = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.206197 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.tls_enabled              = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.206197 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] cache.tls_keyfile              = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.207696 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.207696 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep.group                  = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.207696 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep.helper_command         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.207696 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep.thread_pool_size       = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.207696 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep.user                   = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.207696 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.207696 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_dhcp_release.group     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.207696 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.209047 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.209047 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_dhcp_release.user      = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.209047 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.209047 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.209047 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.209047 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.209047 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.209047 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.209047 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_namespace.group        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.210859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.210859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.210859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_namespace.user         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.210859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.210859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_conntrack.group        = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.210859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.210859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.210859 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] privsep_conntrack.user         = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.212992 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] AGENT.root_helper              = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.212992 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon       = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.212992 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read   = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.212992 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset     = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.212992 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.212992 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver  = openvswitch {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.212992 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.212992 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.extension_drivers          = ['port_security'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.214018 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.external_network_type      = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.214018 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.mechanism_drivers          = ['openvswitch', 'hyperv'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.214018 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.overlay_ip_version         = 4 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.214018 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.path_mtu                   = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.214018 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.physical_network_mtus      = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.214018 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.tenant_network_types       = ['vlan'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.214018 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.214018 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks    = ['physnet1'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.215071 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.215071 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges     = ['1:1000'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.215071 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges  = ['1:1000'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.215071 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:350:399'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.215071 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges      = ['1:1000'] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.215071 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group     = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.215071 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.215071 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.backend               = sqlalchemy {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216215 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.connection            = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216215 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.connection_debug      = 0 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216215 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.connection_parameters =  {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216215 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216215 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.connection_trace      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216215 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216215 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.db_max_retries        = 20 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216948 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216948 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.db_retry_interval     = 1 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216948 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.max_overflow          = 50 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216948 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.max_pool_size         = 50 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.216948 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.max_retries           = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.217783 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.mysql_enable_ndb      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.217783 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.217783 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.pool_timeout          = None {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.217783 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.retry_interval        = 10 {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.217783 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.slave_connection      = **** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.219298 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.sqlite_synchronous    = True {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.219298 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] database.use_db_reconnect      = False {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
May 27 09:18:57.219298 dv-cinder-772623-6-iscsi neutron-server[91715]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
May 27 09:19:08.568571 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6c539ce2-39f3-493c-b563-55de9556e6ed None None] get_active_networks_info from dv-cinder-772623-6-iscsi {{(pid=91822) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}}
May 27 09:19:08.652350 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c539ce2-39f3-493c-b563-55de9556e6ed None None] No non-hosted networks {{(pid=91822) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}}
May 27 09:19:08.676229 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.agentschedulers_db [None req-6c539ce2-39f3-493c-b563-55de9556e6ed None None] DHCP Agent not found on host dv-cinder-772623-6-iscsi {{(pid=91822) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}}
May 27 09:19:08.808963 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e8beb423-4a96-444a-aa5d-3514dc3e021a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271'] for agent, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:11.422234 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271'] for agent, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:11.423841 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.424380 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.424932 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.425473 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.425844 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.426341 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.426821 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.427446 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.427925 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.429126 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.429914 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.430401 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:11.430908 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f2eedada2b0>, 'Open vSwitch agent', 'dv-cinder-772623-6-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:19:11.440136 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (<neutron_lib.context.Context object at 0x7f2eed1f05b0>,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-772623-6-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:19:11.761096 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48a936ef-5ef7-4813-8149-3e5de37be6fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271'] for agent, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:11.846952 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ef137b22-4f18-419b-9d5f-40dc6473775b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:12.380594 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271'] for agent, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:14.929101 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271'] for agent, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:16.685991 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 45258) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:17.150239 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.db.l3_hamode_db [None req-af509da4-cd95-4337-a8a7-fbf1f754895a None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1
May 27 09:19:17.303134 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af509da4-cd95-4337-a8a7-fbf1f754895a None None] Routers set() bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:19:17.303700 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af509da4-cd95-4337-a8a7-fbf1f754895a None None] Router IDs set() for agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}}
May 27 09:19:17.485945 dv-cinder-772623-6-iscsi neutron-server[91821]: WARNING oslo_policy.policy [None req-ededa8cb-6dff-45ad-be47-6ee2c52e01ad admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 27 09:19:17.486583 dv-cinder-772623-6-iscsi neutron-server[91821]: WARNING oslo_policy.policy [None req-ededa8cb-6dff-45ad-be47-6ee2c52e01ad admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 27 09:19:17.717145 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [None req-ededa8cb-6dff-45ad-be47-6ee2c52e01ad admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91821) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:19:17.718297 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-ededa8cb-6dff-45ad-be47-6ee2c52e01ad admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 1.0312407
May 27 09:19:20.127121 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 45272) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:20.504731 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-6a0bdf3c-27e9-4b8a-bc82-be6338d741c8 admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'is_default': True, 'default_prefixlen': 26, 'shared': True, 'prefixes': ['172.20.0.0/16']}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:19:20.605488 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.policy [None req-6a0bdf3c-27e9-4b8a-bc82-be6338d741c8 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91821) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 27 09:19:20.650723 dv-cinder-772623-6-iscsi neutron-server[91821]: WARNING oslo_policy.policy [None req-6a0bdf3c-27e9-4b8a-bc82-be6338d741c8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 27 09:19:20.651095 dv-cinder-772623-6-iscsi neutron-server[91821]: WARNING oslo_policy.policy [None req-6a0bdf3c-27e9-4b8a-bc82-be6338d741c8 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 27 09:19:20.659508 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.quota [None req-6a0bdf3c-27e9-4b8a-bc82-be6338d741c8 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f2eed828ca0>.
May 27 09:19:20.675077 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-6a0bdf3c-27e9-4b8a-bc82-be6338d741c8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:19:20.734034 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6a0bdf3c-27e9-4b8a-bc82-be6338d741c8 admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8739970790039', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8739970789622', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8739970780883', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8739970806375', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8739970795756', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8739970824014', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-532105', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-583691', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3745294', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3917232'] for rbac-policy, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:20.796949 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6a0bdf3c-27e9-4b8a-bc82-be6338d741c8 admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:20.798218 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-6a0bdf3c-27e9-4b8a-bc82-be6338d741c8 admin admin] 10.222.0.30 "POST /v2.0/subnetpools HTTP/1.1" status: 201  len: 739 time: 0.6700685
May 27 09:19:23.438988 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 45286) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:24.065040 dv-cinder-772623-6-iscsi neutron-server[91820]: WARNING oslo_policy.policy [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 27 09:19:24.065644 dv-cinder-772623-6-iscsi neutron-server[91820]: WARNING oslo_policy.policy [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 27 09:19:24.283377 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Request body: {'network': {'project_id': '881fdcd29e994c06befb4d46a6e68859', 'admin_state_up': True, 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'name': 'private'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:19:24.285035 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.quota [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Loaded quota_driver: <neutron.db.quota.driver.DbQuotaDriver object at 0x7f2eedb11c70>.
May 27 09:19:24.300831 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:19:24.307885 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Usage tracker for resource:network and tenant:881fdcd29e994c06befb4d46a6e68859 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:19:24.313446 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:19:24.320954 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:19:24.336545 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Made reservation on behalf of 881fdcd29e994c06befb4d46a6e68859 for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:19:24.408162 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.policy [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91820) register_rules /opt/stack/neutron/neutron/policy.py:73}}
May 27 09:19:24.454122 dv-cinder-772623-6-iscsi neutron-server[91820]: WARNING oslo_policy.policy [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 27 09:19:24.454727 dv-cinder-772623-6-iscsi neutron-server[91820]: WARNING oslo_policy.policy [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html.
May 27 09:19:24.465142 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:24.486565 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:24.501366 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:19:24.505037 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Usage tracker for resource:security_group_rule and tenant:881fdcd29e994c06befb4d46a6e68859 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:19:24.510394 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:19:24.516187 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:19:24.619857 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:24.623976 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:24.629665 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:24.650373 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] vlan segment allocate from pool success with {'vlan_id': 357, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:19:24.676100 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8739971585262', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:24.676803 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f2eee6d4ee0> segment precommit_create {{(pid=91820) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 27 09:19:24.677360 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Added segment 669e20bd-4960-4203-a40e-f1b7cbd0b205 of type vlan for network a213a696-6022-4cd0-b107-2dc71040c05a
May 27 09:19:24.686055 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2e7cc8f-68c4-488b-8918-93e6f6333fa3,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:24.745971 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.746319 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.746649 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.746972 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.747286 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.747647 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.747958 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.748266 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.748589 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.748897 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.749198 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.749500 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Tracked resource versions report:
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]: pushed versions:
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]: {   'AddressGroup': {'1.2'},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     'ConntrackHelper': {'1.0'},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     'Log': {'1.0'},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     'Network': {'1.1'},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     'Port': {'1.7'},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     'PortForwarding': {'1.2'},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     'QosPolicy': {'1.8'},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     'SecurityGroup': {'1.4'},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     'SecurityGroupRule': {'1.2'},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     'SubPort': {'1.0'},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     'Subnet': {'1.1'},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     'Trunk': {'1.1'}}
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]: consumer versions:
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]: {   DHCP agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     L3 agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     Metadata agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     Metering agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:     Open vSwitch agent@dv-cinder-772623-6-iscsi: {   'AddressGroup': '1.2',
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'ConntrackHelper': '1.0',
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'Log': '1.0',
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'Network': '1.1',
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'Port': '1.7',
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'PortForwarding': '1.2',
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'QosPolicy': '1.8',
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'SecurityGroup': '1.4',
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'SecurityGroupRule': '1.2',
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'SubPort': '1.0',
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'Subnet': '1.1',
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'Trunk': '1.1'}}
May 27 09:19:24.750541 dv-cinder-772623-6-iscsi neutron-server[91820]:  {{(pid=91820) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 27 09:19:24.803132 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:24.807234 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:24.848541 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:24.850643 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:19:24.851317 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:24.856148 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:24.960528 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 849 time: 1.5193691
May 27 09:19:24.961214 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Pushing event updated for resources: {'Network': ['ID=a213a696-6022-4cd0-b107-2dc71040c05a,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:24.964713 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:24.974377 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network a213a696-6022-4cd0-b107-2dc71040c05a details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:19:27.737028 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 45308) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:28.207272 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05a57275-50e9-4260-b8a3-4646c4e44cf8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:19:28.208586 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-05a57275-50e9-4260-b8a3-4646c4e44cf8 admin admin] 10.222.0.30 "GET /v2.0/networks/a213a696-6022-4cd0-b107-2dc71040c05a HTTP/1.1" status: 200  len: 825 time: 0.4705858
May 27 09:19:28.240486 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-b777ce03-8ecf-4a39-a468-1df0fe781588 admin admin] 10.222.0.30 "GET /v2.0/subnetpools/bbbeb792-5c41-41d2-a4fb-8138f1d85b39 HTTP/1.1" status: 200  len: 734 time: 0.0259395
May 27 09:19:28.249240 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Request body: {'subnet': {'name': 'private-subnet', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a', 'ip_version': 4, 'subnetpool_id': 'bbbeb792-5c41-41d2-a4fb-8138f1d85b39', 'gateway_ip': '172.20.0.1'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:19:28.254001 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:19:28.262224 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Usage tracker for resource:subnet and tenant:881fdcd29e994c06befb4d46a6e68859 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:19:28.262224 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:19:28.269011 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:19:28.280122 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Made reservation on behalf of 881fdcd29e994c06befb4d46a6e68859 for: {'subnet': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:19:28.282459 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Notify callbacks [] for subnet, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:28.787616 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810'] for subnet, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:28.791874 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:28.871670 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Pushing event updated for resources: {'Subnet': ['ID=8bd95cea-0745-40c9-8f8c-38a4299f4355,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:28.875797 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Checking segment: {'id': '669e20bd-4960-4203-a40e-f1b7cbd0b205', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:19:28.876173 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Network hostable DHCP agents. Network: a213a696-6022-4cd0-b107-2dc71040c05a, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91820) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:19:28.878900 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:28.895602 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Network a213a696-6022-4cd0-b107-2dc71040c05a is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91820) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:19:28.906038 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, a213a696-6022-4cd0-b107-2dc71040c05a) {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:19:28.910684 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:19:28.911295 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:28.917454 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-18ab2e21-2545-4e32-a345-02a9d0327fab None None] Network a213a696-6022-4cd0-b107-2dc71040c05a requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:19:28.943532 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 854 time: 0.6893191
May 27 09:19:29.237088 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp391d76a4-97d4-5c01-84fd-9bc405269bae-a213a696-6022-4cd0-b107-2dc71040c05a', 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'fixed_ips': [{'subnet_id': '8bd95cea-0745-40c9-8f8c-38a4299f4355'}]}} from dv-cinder-772623-6-iscsi. {{(pid=91822) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 27 09:19:29.238278 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:29.432819 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.db_base_plugin_common [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Allocated IP 172.20.0.2 (a213a696-6022-4cd0-b107-2dc71040c05a/8bd95cea-0745-40c9-8f8c-38a4299f4355/809db600-59a3-4441-94e1-d8f4e032c9b1) {{(pid=91822) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:19:29.668798 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Notify callbacks [] for port, precommit_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:29.682944 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Transition to ACTIVE for port object 809db600-59a3-4441-94e1-d8f4e032c9b1 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:19:29.705677 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Transition to ACTIVE for port object 809db600-59a3-4441-94e1-d8f4e032c9b1 will not be triggered until provisioned by entity DHCP. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:19:29.712864 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:29.718021 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:29.779064 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Network a213a696-6022-4cd0-b107-2dc71040c05a is already hosted by enough agents. {{(pid=91822) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:19:29.782145 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.base_scheduler [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Resources bound (agent type, host, resource id):  {{(pid=91822) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:19:29.789691 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Received port after_create {{(pid=91822) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:19:29.791981 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Pushing event updated for resources: {'Port': ['ID=809db600-59a3-4441-94e1-d8f4e032c9b1,revision_number=1']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:29.827025 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.827398 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.827723 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.828050 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.829982 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.829982 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.829982 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.829982 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.829982 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.830399 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.830399 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.830553 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Tracked resource versions report:
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]: pushed versions:
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]: {   'AddressGroup': {'1.2'},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     'ConntrackHelper': {'1.0'},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     'Log': {'1.0'},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     'Network': {'1.1'},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     'Port': {'1.7'},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     'PortForwarding': {'1.2'},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     'QosPolicy': {'1.8'},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     'SecurityGroup': {'1.4'},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     'SecurityGroupRule': {'1.2'},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     'SubPort': {'1.0'},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     'Subnet': {'1.1'},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     'Trunk': {'1.1'}}
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]: consumer versions:
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]: {   DHCP agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     L3 agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     Metadata agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     Metering agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:     Open vSwitch agent@dv-cinder-772623-6-iscsi: {   'AddressGroup': '1.2',
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'ConntrackHelper': '1.0',
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'Log': '1.0',
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'Network': '1.1',
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'Port': '1.7',
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'PortForwarding': '1.2',
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'QosPolicy': '1.8',
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'SecurityGroup': '1.4',
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'SecurityGroupRule': '1.2',
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'SubPort': '1.0',
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'Subnet': '1.1',
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'Trunk': '1.1'}}
May 27 09:19:29.831578 dv-cinder-772623-6-iscsi neutron-server[91822]:  {{(pid=91822) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 27 09:19:29.840060 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:29.899156 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Attempting to bind port 809db600-59a3-4441-94e1-d8f4e032c9b1 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:19:29.899573 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Attempting to bind port 809db600-59a3-4441-94e1-d8f4e032c9b1 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '669e20bd-4960-4203-a40e-f1b7cbd0b205', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:19:29.900023 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Attempting to bind port 809db600-59a3-4441-94e1-d8f4e032c9b1 on network a213a696-6022-4cd0-b107-2dc71040c05a {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:19:29.905475 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 19, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:19:29.905873 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Checking segment: {'id': '669e20bd-4960-4203-a40e-f1b7cbd0b205', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:19:29.906349 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:29.906735 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Bound using segment: {'id': '669e20bd-4960-4203-a40e-f1b7cbd0b205', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:19:29.907266 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Bound port: 809db600-59a3-4441-94e1-d8f4e032c9b1, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '669e20bd-4960-4203-a40e-f1b7cbd0b205', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:19:29.907659 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:30.001647 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] For port 809db600-59a3-4441-94e1-d8f4e032c9b1, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:19:30.005532 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] For port 809db600-59a3-4441-94e1-d8f4e032c9b1, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=809db600-59a3-4441-94e1-d8f4e032c9b1,segment=NetworkSegment(669e20bd-4960-4203-a40e-f1b7cbd0b205),segment_id=669e20bd-4960-4203-a40e-f1b7cbd0b205)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:19:30.010666 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:30.014585 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:30.098435 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Pushing event updated for resources: {'Port': ['ID=809db600-59a3-4441-94e1-d8f4e032c9b1,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:30.103665 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:31.501125 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 45318) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:31.906829 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [None req-5ed3ee0a-39a3-4022-9f35-c4915e854791 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91821) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:19:31.907835 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-5ed3ee0a-39a3-4022-9f35-c4915e854791 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.4057529
May 27 09:19:34.354320 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 45328) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:34.774273 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [None req-d7f414d3-085f-4894-812c-cb7c9ade04c7 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91821) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:19:34.775248 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-d7f414d3-085f-4894-812c-cb7c9ade04c7 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.4200048
May 27 09:19:35.825813 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83f135aa-5e50-4f0c-a920-93aa510ee076 None None] Network a213a696-6022-4cd0-b107-2dc71040c05a requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:19:35.916331 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-e7c0b959-0ef7-4d0f-af82-c3e1337be8d1 None None] Provisioning for port 809db600-59a3-4441-94e1-d8f4e032c9b1 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:19:35.960253 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 809db600-59a3-4441-94e1-d8f4e032c9b1 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:19:36.100065 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 809db600-59a3-4441-94e1-d8f4e032c9b1 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:19:36.131271 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 809db600-59a3-4441-94e1-d8f4e032c9b1 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:19:36.131703 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:36.284635 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:36.321290 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 809db600-59a3-4441-94e1-d8f4e032c9b1, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=809db600-59a3-4441-94e1-d8f4e032c9b1,segment=NetworkSegment(669e20bd-4960-4203-a40e-f1b7cbd0b205),segment_id=669e20bd-4960-4203-a40e-f1b7cbd0b205)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:19:36.325707 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:36.327967 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:36.405842 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=809db600-59a3-4441-94e1-d8f4e032c9b1,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:36.413920 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:36.456850 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-584c7f21-49be-43c0-984b-d1c59f21ddc3 None None] Provisioning complete for port 809db600-59a3-4441-94e1-d8f4e032c9b1 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:19:36.457217 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-584c7f21-49be-43c0-984b-d1c59f21ddc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:37.505034 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 45344) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:37.895586 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-6ff69fdd-77d5-40c5-89c9-5c2bdb5de8b7 admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'name': 'router1'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:19:37.901577 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-6ff69fdd-77d5-40c5-89c9-5c2bdb5de8b7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:19:37.906222 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-6ff69fdd-77d5-40c5-89c9-5c2bdb5de8b7 admin admin] Usage tracker for resource:router and tenant:881fdcd29e994c06befb4d46a6e68859 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:19:37.910268 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-6ff69fdd-77d5-40c5-89c9-5c2bdb5de8b7 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:19:37.918755 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-6ff69fdd-77d5-40c5-89c9-5c2bdb5de8b7 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:19:37.923866 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 809db600-59a3-4441-94e1-d8f4e032c9b1 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:19:37.932067 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6ff69fdd-77d5-40c5-89c9-5c2bdb5de8b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3812772', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1963'] for router, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:37.933908 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6ff69fdd-77d5-40c5-89c9-5c2bdb5de8b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3855012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3811180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3881146', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1952'] for router, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:37.961806 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6ff69fdd-77d5-40c5-89c9-5c2bdb5de8b7 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:38.025331 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 809db600-59a3-4441-94e1-d8f4e032c9b1 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:19:38.025698 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:38.086944 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6ff69fdd-77d5-40c5-89c9-5c2bdb5de8b7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3812787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3811082'] for router, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:38.108999 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6ff69fdd-77d5-40c5-89c9-5c2bdb5de8b7 admin admin] Notify callbacks [] for router, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:38.110718 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-6ff69fdd-77d5-40c5-89c9-5c2bdb5de8b7 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201  len: 709 time: 0.6044786
May 27 09:19:38.456413 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-b7358dd3-5c27-429a-a4f6-a3640304ec68 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:40.566963 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 45354) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:40.949752 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [None req-b32dfb24-0cec-4443-9ff7-7bf3e3d9cfc7 admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91821) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:19:40.950727 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-b32dfb24-0cec-4443-9ff7-7bf3e3d9cfc7 admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3828096
May 27 09:19:41.410588 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:41.751667 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ecc1961d-b01f-4873-8b93-cc57fb9ae31b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:42.296840 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:43.357415 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 45374) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:43.529717 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Request body: {'network': {'provider:physical_network': 'physnet1', 'name': 'public', 'router:external': True, 'provider:network_type': 'flat', 'admin_state_up': True, 'is_default': True}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:19:43.534974 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:19:43.539242 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Usage tracker for resource:network and tenant:61d631a5c0f64cc59cd1457e62697bdf is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:19:43.542636 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:19:43.548429 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:19:43.558872 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Made reservation on behalf of 61d631a5c0f64cc59cd1457e62697bdf for: {'network': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:19:43.561638 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:43.578998 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:43.596324 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:19:43.601018 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Usage tracker for resource:security_group_rule and tenant:61d631a5c0f64cc59cd1457e62697bdf is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:19:43.604472 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:19:43.610235 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:19:43.709921 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:43.713836 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:43.719535 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:43.731471 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Reserving flat network on physical network physnet1 {{(pid=91821) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}}
May 27 09:19:43.762052 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8739971585262', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:43.762685 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Unsubscribe: <function _add_segment_host_mapping_for_segment at 0x7f2eee6d4ee0> segment precommit_create {{(pid=91821) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}}
May 27 09:19:43.763175 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.segments_db [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Added segment c9d11f8e-7743-4d8a-b53e-c5e082b29e82 of type flat for network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae
May 27 09:19:43.819388 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=801115b9-9de5-485c-aa08-a8178f95521e,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:43.837100 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.837452 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.837786 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.838112 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.838436 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.838771 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.839089 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.839428 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.840022 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.840337 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.840650 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.840957 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Tracked resource versions report:
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]: pushed versions:
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]: {   'AddressGroup': {'1.2'},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     'ConntrackHelper': {'1.0'},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     'Log': {'1.0'},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     'Network': {'1.1'},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     'Port': {'1.7'},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     'PortForwarding': {'1.2'},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     'QosPolicy': {'1.8'},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     'SecurityGroup': {'1.4'},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     'SecurityGroupRule': {'1.2'},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     'SubPort': {'1.0'},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     'Subnet': {'1.1'},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     'Trunk': {'1.1'}}
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]: consumer versions:
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]: {   DHCP agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     L3 agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     Metadata agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     Metering agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:     Open vSwitch agent@dv-cinder-772623-6-iscsi: {   'AddressGroup': '1.2',
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'ConntrackHelper': '1.0',
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'Log': '1.0',
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'Network': '1.1',
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'Port': '1.7',
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'PortForwarding': '1.2',
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'QosPolicy': '1.8',
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'SecurityGroup': '1.4',
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'SecurityGroupRule': '1.2',
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'SubPort': '1.0',
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'Subnet': '1.1',
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'Trunk': '1.1'}}
May 27 09:19:43.842000 dv-cinder-772623-6-iscsi neutron-server[91821]:  {{(pid=91821) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 27 09:19:43.892590 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:43.897190 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:43.944842 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:43.946290 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:19:43.946940 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:43.952337 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:44.059285 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Pushing event updated for resources: {'Network': ['ID=8ebf3ddf-9506-4320-bd22-b3ade14a6cae,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:44.062430 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.7041171
May 27 09:19:44.077053 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:44.090668 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:19:44.813818 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:46.267953 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 45398) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:46.394313 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec059a8f-7589-48c2-8225-240348349d38 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:19:46.395711 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-ec059a8f-7589-48c2-8225-240348349d38 admin admin] 10.222.0.30 "GET /v2.0/subnets/8bd95cea-0745-40c9-8f8c-38a4299f4355 HTTP/1.1" status: 200  len: 849 time: 0.1266801
May 27 09:19:46.595605 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-acb32899-6d0c-4513-8b17-b5cdec83f581 admin admin] 10.222.0.30 "GET /v2.0/routers/62cbf4ab-847e-4326-8c69-d9e46ac51d65 HTTP/1.1" status: 200  len: 704 time: 0.1936526
May 27 09:19:47.073219 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:47.322988 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Allocated IP 172.20.0.1 (a213a696-6022-4cd0-b107-2dc71040c05a/8bd95cea-0745-40c9-8f8c-38a4299f4355/6485d3e5-e2c7-4a14-af8c-9e93adacb617) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:19:47.482095 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:47.499579 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Transition to ACTIVE for port object 6485d3e5-e2c7-4a14-af8c-9e93adacb617 will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:19:47.554184 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:47.558630 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:47.624071 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Network a213a696-6022-4cd0-b107-2dc71040c05a is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:19:47.626944 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:19:47.633113 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:19:47.633113 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3816556'] for router_interface, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:47.754348 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Pushing event updated for resources: {'Port': ['ID=6485d3e5-e2c7-4a14-af8c-9e93adacb617,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:47.769944 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:47.874470 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-a86621c7-0d99-479b-8d2c-37ac53d12c01 None None] Provisioning for port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:19:47.879272 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-a86621c7-0d99-479b-8d2c-37ac53d12c01 None None] Provisioning complete for port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:19:47.879672 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a86621c7-0d99-479b-8d2c-37ac53d12c01 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:47.931480 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-a86621c7-0d99-479b-8d2c-37ac53d12c01 None None] Port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:19:47.940740 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:48.168941 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:48.173476 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:48.174731 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3683833', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3816655'] for router_interface, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:48.178947 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:48.312427 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Pushing event updated for resources: {'Port': ['ID=6485d3e5-e2c7-4a14-af8c-9e93adacb617,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:48.316408 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:48.376995 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Network a213a696-6022-4cd0-b107-2dc71040c05a is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:19:48.378052 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:19:48.554550 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-0808b069-3c9c-4398-89b6-03a9095671ae None None] Provisioning complete for port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:19:48.554916 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-0808b069-3c9c-4398-89b6-03a9095671ae None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:48.566072 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Router 62cbf4ab-847e-4326-8c69-d9e46ac51d65 is scheduled to L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 with binding_index 1 {{(pid=91820) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 27 09:19:48.612843 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-0808b069-3c9c-4398-89b6-03a9095671ae None None] Port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:19:48.726763 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:19:48.736013 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] 10.222.0.30 "PUT /v2.0/routers/62cbf4ab-847e-4326-8c69-d9e46ac51d65/add_router_interface HTTP/1.1" status: 200  len: 508 time: 2.1351123
May 27 09:19:48.736701 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Sync routers for ids ['62cbf4ab-847e-4326-8c69-d9e46ac51d65'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:19:48.748140 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Routers {'62cbf4ab-847e-4326-8c69-d9e46ac51d65'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:19:48.748989 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eeda99c70>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:19:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['62cbf4ab-847e-4326-8c69-d9e46ac51d65'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:19:48.926208 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Set router 62cbf4ab-847e-4326-8c69-d9e46ac51d65 gateway port host: None {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:19:49.308138 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eeda99c70>, [{'id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'name': 'router1', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:19:37Z', 'updated_at': '2021-05-27T09:19:47Z', 'revision_number': 2, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'gw_port_host': None, '_interfaces': [{'id': '6485d3e5-e2c7-4a14-af8c-9e93adacb617', 'name': '', 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'mac_address': 'fa:16:3e:13:41:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:19:47Z', 'updated_at': '2021-05-27T09:19:48Z', 'revision_number': 2, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'subnets': [{'id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bbbeb792-5c41-41d2-a4fb-8138f1d85b39'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:19:49.313238 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Checking router: 62cbf4ab-847e-4326-8c69-d9e46ac51d65 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:19:49.313609 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Updating router 62cbf4ab-847e-4326-8c69-d9e46ac51d65 port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 binding host dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:19:49.367031 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:49.754991 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Notify callbacks [] for port, precommit_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:49.770706 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.provisioning_blocks [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Transition to ACTIVE for port object 6485d3e5-e2c7-4a14-af8c-9e93adacb617 will not be triggered until provisioned by entity L2. {{(pid=91823) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:19:49.778343 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:49.786489 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:49.928209 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Pushing event updated for resources: {'Port': ['ID=6485d3e5-e2c7-4a14-af8c-9e93adacb617,revision_number=3']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:49.971093 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.971467 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.971806 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.972136 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.972461 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.972787 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.973107 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.973425 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.973744 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.974061 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.975051 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.975528 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Tracked resource versions report:
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]: pushed versions:
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]: {   'AddressGroup': {'1.2'},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     'ConntrackHelper': {'1.0'},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     'Log': {'1.0'},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     'Network': {'1.1'},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     'Port': {'1.7'},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     'PortForwarding': {'1.2'},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     'QosPolicy': {'1.8'},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     'SecurityGroup': {'1.4'},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     'SecurityGroupRule': {'1.2'},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     'SubPort': {'1.0'},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     'Subnet': {'1.1'},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     'Trunk': {'1.1'}}
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]: consumer versions:
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]: {   DHCP agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     L3 agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     Metadata agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     Metering agent@dv-cinder-772623-6-iscsi: {},
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:     Open vSwitch agent@dv-cinder-772623-6-iscsi: {   'AddressGroup': '1.2',
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'ConntrackHelper': '1.0',
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'Log': '1.0',
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'Network': '1.1',
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'Port': '1.7',
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'PortForwarding': '1.2',
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'QosPolicy': '1.8',
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'SecurityGroup': '1.4',
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'SecurityGroupRule': '1.2',
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'SubPort': '1.0',
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'Subnet': '1.1',
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'Trunk': '1.1'}}
May 27 09:19:49.976689 dv-cinder-772623-6-iscsi neutron-server[91823]:  {{(pid=91823) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 27 09:19:50.010724 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.224s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:50.031853 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Attempting to bind port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:19:50.032250 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Attempting to bind port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '669e20bd-4960-4203-a40e-f1b7cbd0b205', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a'}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:19:50.032705 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Attempting to bind port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 on network a213a696-6022-4cd0-b107-2dc71040c05a {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:19:50.039012 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 19, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:19:50.039437 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Checking segment: {'id': '669e20bd-4960-4203-a40e-f1b7cbd0b205', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91823) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:19:50.039925 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:50.040322 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Bound using segment: {'id': '669e20bd-4960-4203-a40e-f1b7cbd0b205', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a'} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:19:50.040881 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Bound port: 6485d3e5-e2c7-4a14-af8c-9e93adacb617, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '669e20bd-4960-4203-a40e-f1b7cbd0b205', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 357, 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a'}}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:19:50.041257 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:50.130637 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] For port 6485d3e5-e2c7-4a14-af8c-9e93adacb617, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91823) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:19:50.135326 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] For port 6485d3e5-e2c7-4a14-af8c-9e93adacb617, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=6485d3e5-e2c7-4a14-af8c-9e93adacb617,segment=NetworkSegment(669e20bd-4960-4203-a40e-f1b7cbd0b205),segment_id=669e20bd-4960-4203-a40e-f1b7cbd0b205)] {{(pid=91823) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:19:50.139915 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:50.144651 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:50.232751 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Routers {'62cbf4ab-847e-4326-8c69-d9e46ac51d65'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:19:50.233394 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eeda99c70>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:19:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['62cbf4ab-847e-4326-8c69-d9e46ac51d65'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:19:50.291255 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Pushing event updated for resources: {'Port': ['ID=6485d3e5-e2c7-4a14-af8c-9e93adacb617,revision_number=4']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:50.305133 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:50.405687 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] Set router 62cbf4ab-847e-4326-8c69-d9e46ac51d65 gateway port host: None {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:19:50.811985 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eeda99c70>, [{'id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'name': 'router1', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:19:37Z', 'updated_at': '2021-05-27T09:19:47Z', 'revision_number': 2, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'gw_port_host': None, '_interfaces': [{'id': '6485d3e5-e2c7-4a14-af8c-9e93adacb617', 'name': '', 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'mac_address': 'fa:16:3e:13:41:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:19:47Z', 'updated_at': '2021-05-27T09:19:50Z', 'revision_number': 4, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'subnets': [{'id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bbbeb792-5c41-41d2-a4fb-8138f1d85b39'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:19:50.817191 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-70020861-4d7f-4476-9445-81b223b59fd0 None None] The sync data for ids ['62cbf4ab-847e-4326-8c69-d9e46ac51d65'] in dv-cinder-772623-6-iscsi is: [{'id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'name': 'router1', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:19:37Z', 'updated_at': '2021-05-27T09:19:47Z', 'revision_number': 2, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'gw_port_host': None, '_interfaces': [{'id': '6485d3e5-e2c7-4a14-af8c-9e93adacb617', 'name': '', 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'mac_address': 'fa:16:3e:13:41:ed', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:19:47Z', 'updated_at': '2021-05-27T09:19:50Z', 'revision_number': 4, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'subnets': [{'id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bbbeb792-5c41-41d2-a4fb-8138f1d85b39'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:19:50.961822 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 45410) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:51.130198 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ec52e54-4a9e-4244-a230-3d3bfe611172 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:19:51.131383 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-1ec52e54-4a9e-4244-a230-3d3bfe611172 admin admin] Synchronizing usage tracker for tenant:61d631a5c0f64cc59cd1457e62697bdf on resource:network {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:19:51.157185 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-1ec52e54-4a9e-4244-a230-3d3bfe611172 admin admin] Unset dirty status for tenant:61d631a5c0f64cc59cd1457e62697bdf on resource:network {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:19:51.158591 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-1ec52e54-4a9e-4244-a230-3d3bfe611172 admin admin] 10.222.0.30 "GET /v2.0/networks/8ebf3ddf-9506-4320-bd22-b3ade14a6cae HTTP/1.1" status: 200  len: 842 time: 0.1956165
May 27 09:19:51.168985 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Request body: {'subnet': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'ip_version': 4, 'name': 'public-subnet', 'enable_dhcp': False}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:19:51.182641 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:19:51.187013 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Usage tracker for resource:subnet and tenant:61d631a5c0f64cc59cd1457e62697bdf is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:19:51.190283 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:19:51.197658 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:19:51.209715 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Made reservation on behalf of 61d631a5c0f64cc59cd1457e62697bdf for: {'subnet': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:19:51.212945 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:51.702529 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.objects.ports [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=91821) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}}
May 27 09:19:51.702997 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810'] for subnet, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:51.707303 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:51.791354 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4506464c-a125-4c0f-8a03-19e4816fe82e,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:51.796188 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Checking segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:19:51.796572 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Network hostable DHCP agents. Network: 8ebf3ddf-9506-4320-bd22-b3ade14a6cae, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91821) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:19:51.800988 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:51.820769 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91821) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:19:51.831636 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 8ebf3ddf-9506-4320-bd22-b3ade14a6cae) {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:19:51.841038 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:19:51.841775 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-695ffee3-9fc2-4fc7-be16-5023c1755b74 None None] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:19:51.842204 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:51.865723 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 821 time: 0.6997645
May 27 09:19:52.060474 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46e8aff5-57b2-45b9-94eb-af5c8e5eb4ad None None] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:19:53.947086 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 6485d3e5-e2c7-4a14-af8c-9e93adacb617 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:19:54.019905 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:19:54.025472 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:19:54.025847 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:54.155015 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:54.189689 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 6485d3e5-e2c7-4a14-af8c-9e93adacb617, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=6485d3e5-e2c7-4a14-af8c-9e93adacb617,segment=NetworkSegment(669e20bd-4960-4203-a40e-f1b7cbd0b205),segment_id=669e20bd-4960-4203-a40e-f1b7cbd0b205)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:19:54.194559 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:54.197154 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:54.200216 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 45424) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:54.278330 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=6485d3e5-e2c7-4a14-af8c-9e93adacb617,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:54.281655 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:54.444002 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-a698fca2-b846-4a0d-9049-538930ae2333 admin admin] 10.222.0.30 "GET /v2.0/routers/62cbf4ab-847e-4326-8c69-d9e46ac51d65 HTTP/1.1" status: 200  len: 710 time: 0.2421193
May 27 09:19:54.576589 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28554bd0-8549-42f4-b150-1156e7893e21 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:19:54.577869 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-28554bd0-8549-42f4-b150-1156e7893e21 admin admin] 10.222.0.30 "GET /v2.0/networks/8ebf3ddf-9506-4320-bd22-b3ade14a6cae HTTP/1.1" status: 200  len: 886 time: 0.1279869
May 27 09:19:54.587482 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:19:55.056302 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3811195', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3812794', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2006'] for router, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:55.448993 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:55.514486 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:55.665022 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Allocated IP 172.27.1.107 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/eada87f8-5ac3-4af3-99f9-e496a99a8794) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:19:55.825527 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:55.884895 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:55.888863 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:55.928486 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 6485d3e5-e2c7-4a14-af8c-9e93adacb617 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:19:55.980228 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:19:55.985194 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:19:55.987130 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Pushing event updated for resources: {'Port': ['ID=eada87f8-5ac3-4af3-99f9-e496a99a8794,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:55.998937 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:19:56.000544 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:19:56.000934 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:56.131627 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:56.404903 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:56.810351 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3811195', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3812794', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2006'] for router, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:56.813964 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3811082', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-3811124', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-3811075', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-3812744'] for router, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:57.009852 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Router 62cbf4ab-847e-4326-8c69-d9e46ac51d65 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:19:57.199588 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:19:57.209336 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Notify callbacks [] for router, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:57.209567 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Sync routers for ids ['62cbf4ab-847e-4326-8c69-d9e46ac51d65'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:19:57.210550 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] 10.222.0.30 "PUT /v2.0/routers/62cbf4ab-847e-4326-8c69-d9e46ac51d65 HTTP/1.1" status: 200  len: 890 time: 2.6270111
May 27 09:19:57.219858 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Routers {'62cbf4ab-847e-4326-8c69-d9e46ac51d65'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:19:57.220562 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecfc6c70>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:19:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['62cbf4ab-847e-4326-8c69-d9e46ac51d65'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:19:57.442084 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Set router 62cbf4ab-847e-4326-8c69-d9e46ac51d65 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:19:57.807306 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecfc6c70>, [{'id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'name': 'router1', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.107'}], 'enable_snat': True}, 'gw_port_id': 'eada87f8-5ac3-4af3-99f9-e496a99a8794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:19:37Z', 'updated_at': '2021-05-27T09:19:56Z', 'revision_number': 4, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'gw_port': {'id': 'eada87f8-5ac3-4af3-99f9-e496a99a8794', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:2d:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:19:55Z', 'updated_at': '2021-05-27T09:19:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '6485d3e5-e2c7-4a14-af8c-9e93adacb617', 'name': '', 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'mac_address': 'fa:16:3e:13:41:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:19:47Z', 'updated_at': '2021-05-27T09:19:54Z', 'revision_number': 5, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'subnets': [{'id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bbbeb792-5c41-41d2-a4fb-8138f1d85b39'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:19:57.812295 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Checking router: 62cbf4ab-847e-4326-8c69-d9e46ac51d65 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:19:57.812642 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Updating router 62cbf4ab-847e-4326-8c69-d9e46ac51d65 port eada87f8-5ac3-4af3-99f9-e496a99a8794 binding host dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:19:57.866636 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:58.215931 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Notify callbacks [] for port, precommit_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:58.236552 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Transition to ACTIVE for port object eada87f8-5ac3-4af3-99f9-e496a99a8794 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:19:58.247801 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:58.256286 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:58.404508 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Attempting to bind port eada87f8-5ac3-4af3-99f9-e496a99a8794 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:19:58.405138 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Attempting to bind port eada87f8-5ac3-4af3-99f9-e496a99a8794 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:19:58.405744 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Attempting to bind port eada87f8-5ac3-4af3-99f9-e496a99a8794 on network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:19:58.417058 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-610a1cc7-edb5-4c47-9f64-9f2073d7d940 None None] Pushing event updated for resources: {'Port': ['ID=eada87f8-5ac3-4af3-99f9-e496a99a8794,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:58.425018 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-610a1cc7-edb5-4c47-9f64-9f2073d7d940 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:58.426488 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 19, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:19:58.427119 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Checking segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:19:58.428365 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:58.429030 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Bound using segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:19:58.429863 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Bound port: eada87f8-5ac3-4af3-99f9-e496a99a8794, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:19:58.430481 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:58.530514 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] For port eada87f8-5ac3-4af3-99f9-e496a99a8794, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:19:58.533354 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] For port eada87f8-5ac3-4af3-99f9-e496a99a8794, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=eada87f8-5ac3-4af3-99f9-e496a99a8794,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:19:58.539303 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:19:58.543172 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:19:58.626967 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Routers {'62cbf4ab-847e-4326-8c69-d9e46ac51d65'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:19:58.627647 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecfc6c70>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:19:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['62cbf4ab-847e-4326-8c69-d9e46ac51d65'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:19:58.688852 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-610a1cc7-edb5-4c47-9f64-9f2073d7d940 None None] Pushing event updated for resources: {'Port': ['ID=eada87f8-5ac3-4af3-99f9-e496a99a8794,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:19:58.698815 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-610a1cc7-edb5-4c47-9f64-9f2073d7d940 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:19:58.822794 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] Set router 62cbf4ab-847e-4326-8c69-d9e46ac51d65 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:19:59.220895 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecfc6c70>, [{'id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'name': 'router1', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.107'}], 'enable_snat': True}, 'gw_port_id': 'eada87f8-5ac3-4af3-99f9-e496a99a8794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:19:37Z', 'updated_at': '2021-05-27T09:19:56Z', 'revision_number': 4, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'gw_port': {'id': 'eada87f8-5ac3-4af3-99f9-e496a99a8794', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:2d:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:19:55Z', 'updated_at': '2021-05-27T09:19:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '6485d3e5-e2c7-4a14-af8c-9e93adacb617', 'name': '', 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'mac_address': 'fa:16:3e:13:41:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:19:47Z', 'updated_at': '2021-05-27T09:19:54Z', 'revision_number': 5, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'subnets': [{'id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bbbeb792-5c41-41d2-a4fb-8138f1d85b39'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:19:59.225859 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45e350c6-f339-4ce9-9efd-b70b5e83dc63 None None] The sync data for ids ['62cbf4ab-847e-4326-8c69-d9e46ac51d65'] in dv-cinder-772623-6-iscsi is: [{'id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'name': 'router1', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.107'}], 'enable_snat': True}, 'gw_port_id': 'eada87f8-5ac3-4af3-99f9-e496a99a8794', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:19:37Z', 'updated_at': '2021-05-27T09:19:56Z', 'revision_number': 4, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'gw_port': {'id': 'eada87f8-5ac3-4af3-99f9-e496a99a8794', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:8b:2d:eb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:19:55Z', 'updated_at': '2021-05-27T09:19:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '6485d3e5-e2c7-4a14-af8c-9e93adacb617', 'name': '', 'network_id': 'a213a696-6022-4cd0-b107-2dc71040c05a', 'tenant_id': '881fdcd29e994c06befb4d46a6e68859', 'mac_address': 'fa:16:3e:13:41:ed', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '62cbf4ab-847e-4326-8c69-d9e46ac51d65', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:19:47Z', 'updated_at': '2021-05-27T09:19:54Z', 'revision_number': 5, 'project_id': '881fdcd29e994c06befb4d46a6e68859', 'subnets': [{'id': '8bd95cea-0745-40c9-8f8c-38a4299f4355', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'bbbeb792-5c41-41d2-a4fb-8138f1d85b39'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:19:59.620424 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 45436) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:19:59.743135 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-d4a76475-c999-49ff-bf2b-488ca2c649d9 admin admin] 10.222.0.30 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200  len: 411 time: 0.1215742
May 27 09:19:59.962052 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device eada87f8-5ac3-4af3-99f9-e496a99a8794 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:20:00.040186 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port eada87f8-5ac3-4af3-99f9-e496a99a8794 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:20:00.045269 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port eada87f8-5ac3-4af3-99f9-e496a99a8794 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:20:00.045645 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:00.179938 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:00.198829 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port eada87f8-5ac3-4af3-99f9-e496a99a8794, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=eada87f8-5ac3-4af3-99f9-e496a99a8794,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:20:00.203576 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:00.206637 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:20:00.281500 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=eada87f8-5ac3-4af3-99f9-e496a99a8794,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:20:00.285125 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:20:01.943144 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device eada87f8-5ac3-4af3-99f9-e496a99a8794 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:20:02.024572 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port eada87f8-5ac3-4af3-99f9-e496a99a8794 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:20:02.024947 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:08.475769 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d1146382-fe25-4047-a0e9-638337daa075 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:09.091831 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 5 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:20:11.426954 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:11.771668 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-74458171-551e-4f24-bd4f-578b00f5b48a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:12.338231 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:14.840082 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:38.463194 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-f98328d5-3c97-4a46-bada-1cd7cc303c0d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:41.416090 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:41.764316 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-045280c4-6601-4efa-9e6d-8310a9f8fb19 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:42.312416 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:44.846571 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:20:46.082301 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 5 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:21:08.468993 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-cf9ac100-c9c0-4e5e-ae7c-db92ab555194 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:11.412952 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:11.757901 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-92a74c2a-286d-4f0f-b297-d0f70d7489a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:12.309208 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:14.842976 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:23.081171 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 5 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:21:38.470873 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-fe5553bf-b438-4bb8-889f-7f196bd89253 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:41.381435 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46006) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:21:41.416342 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:41.456392 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.pecan_wsgi.hooks.translation [None req-e73f88d8-c37a-45ee-9409-bb78e4dcaece admin admin] GET failed (client error): The resource could not be found.
May 27 09:21:41.457865 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-e73f88d8-c37a-45ee-9409-bb78e4dcaece admin admin] 10.222.0.30 "GET /v2.0/networks/private HTTP/1.1" status: 404  len: 315 time: 0.0754893
May 27 09:21:41.589796 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0854099-539e-47cc-acc0-cd7e7f30d5d0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:41.591183 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-b0854099-539e-47cc-acc0-cd7e7f30d5d0 admin admin] 10.222.0.30 "GET /v2.0/networks?name=private HTTP/1.1" status: 200  len: 872 time: 0.1293502
May 27 09:21:41.760808 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-925d3410-27d2-4e1b-89bc-45f0f504ab92 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:42.317434 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:43.777992 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46016) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:21:43.888824 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ab05b90-0682-4c66-8e4d-64ff5b54c12c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:43.889712 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-9ab05b90-0682-4c66-8e4d-64ff5b54c12c admin admin] Synchronizing usage tracker for tenant:61d631a5c0f64cc59cd1457e62697bdf on resource:subnet {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:21:43.905827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-9ab05b90-0682-4c66-8e4d-64ff5b54c12c admin admin] Unset dirty status for tenant:61d631a5c0f64cc59cd1457e62697bdf on resource:subnet {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:21:43.906971 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-9ab05b90-0682-4c66-8e4d-64ff5b54c12c admin admin] 10.222.0.30 "GET /v2.0/subnets/8bd95cea-0745-40c9-8f8c-38a4299f4355 HTTP/1.1" status: 200  len: 849 time: 0.1280432
May 27 09:21:43.916972 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:21:44.040476 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Notify callbacks [] for subnet, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:44.244146 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8739971492253'] for subnet, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:44.247841 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-094270e5-9e82-4114-a78e-ab6a86a57946 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:21:44.288431 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:44.289161 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:44.290499 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] 10.222.0.30 "PUT /v2.0/subnets/8bd95cea-0745-40c9-8f8c-38a4299f4355 HTTP/1.1" status: 200  len: 868 time: 0.3773332
May 27 09:21:44.294199 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d4821050-1b26-4d52-a7a5-4bb7c3c85f8a None None] Network a213a696-6022-4cd0-b107-2dc71040c05a requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:21:44.320390 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=8bd95cea-0745-40c9-8f8c-38a4299f4355,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:21:44.328399 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.328766 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.329092 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.329402 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.329732 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.330086 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.330415 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.330739 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.331056 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.331404 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.331755 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.332806 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:21:44.337043 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:21:44.794676 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-90265a2a-4c21-4707-8488-5152deacb895 None None] Provisioning complete for port 6485d3e5-e2c7-4a14-af8c-9e93adacb617 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:21:44.795059 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-90265a2a-4c21-4707-8488-5152deacb895 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:44.865848 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:44.940083 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-90265a2a-4c21-4707-8488-5152deacb895 None None] Provisioning complete for port 809db600-59a3-4441-94e1-d8f4e032c9b1 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:21:44.940462 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-90265a2a-4c21-4707-8488-5152deacb895 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:21:46.425156 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46026) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:21:46.610003 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1cc4ebed-814d-48a2-b2f6-7476e824440d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:46.610388 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1cc4ebed-814d-48a2-b2f6-7476e824440d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:46.611982 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-1cc4ebed-814d-48a2-b2f6-7476e824440d admin admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1851625
May 27 09:21:48.758874 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46036) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:21:48.944619 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a06177f-7127-4d3a-ae6b-61578654c801 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:48.945013 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0a06177f-7127-4d3a-ae6b-61578654c801 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:48.946565 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-0a06177f-7127-4d3a-ae6b-61578654c801 admin admin] 10.222.0.30 "GET /v2.0/networks HTTP/1.1" status: 200  len: 1549 time: 0.1866753
May 27 09:21:51.104546 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46046) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:21:51.275483 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90976d65-b730-4a8e-b4b7-0fbad0eb9532 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:51.276908 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-90976d65-b730-4a8e-b4b7-0fbad0eb9532 admin admin] 10.222.0.30 "GET /v2.0/networks/8ebf3ddf-9506-4320-bd22-b3ade14a6cae HTTP/1.1" status: 200  len: 886 time: 0.1714354
May 27 09:21:53.448427 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46056) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:21:53.636831 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc1640e0-7967-4c5f-a1ba-ffb7ed77cc1c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:53.638157 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-fc1640e0-7967-4c5f-a1ba-ffb7ed77cc1c admin admin] 10.222.0.30 "GET /v2.0/networks/a213a696-6022-4cd0-b107-2dc71040c05a HTTP/1.1" status: 200  len: 869 time: 0.1887975
May 27 09:21:55.779492 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46066) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:21:55.892405 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0aec807b-15ee-4d81-9443-1b57234632eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:55.892881 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0aec807b-15ee-4d81-9443-1b57234632eb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:55.895299 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-0aec807b-15ee-4d81-9443-1b57234632eb admin admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1146288
May 27 09:21:58.083485 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46076) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:21:58.237429 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41ad0c87-9e05-492e-8582-010977031716 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:58.237847 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41ad0c87-9e05-492e-8582-010977031716 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:21:58.239390 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-41ad0c87-9e05-492e-8582-010977031716 admin admin] 10.222.0.30 "GET /v2.0/subnets HTTP/1.1" status: 200  len: 1479 time: 0.1549540
May 27 09:22:00.080159 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 5 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:22:00.368022 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46086) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:22:00.470988 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c289fe3-5e85-4e02-a180-7b2793d137d8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:22:00.472376 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-7c289fe3-5e85-4e02-a180-7b2793d137d8 admin admin] 10.222.0.30 "GET /v2.0/subnets/4506464c-a125-4c0f-8a03-19e4816fe82e HTTP/1.1" status: 200  len: 816 time: 0.1033916
May 27 09:22:02.604119 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46096) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:22:02.715762 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d9642d42-ff6f-499a-89b4-36d60ef65a5b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:22:02.717362 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-d9642d42-ff6f-499a-89b4-36d60ef65a5b admin admin] 10.222.0.30 "GET /v2.0/subnets/8bd95cea-0745-40c9-8f8c-38a4299f4355 HTTP/1.1" status: 200  len: 868 time: 0.1123071
May 27 09:22:08.464793 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3918be8b-2739-4e2c-81f4-3a722dbec49e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:11.421063 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:11.770417 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-beb1930d-aa27-480a-9552-65f663dc2767 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:12.314889 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:14.856340 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:26.568780 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46140) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:22:26.626783 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [None req-3966b7aa-a3d8-43f3-a755-f83fcdbefc6b admin admin] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91820) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:22:26.628306 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-3966b7aa-a3d8-43f3-a755-f83fcdbefc6b admin admin] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0581353
May 27 09:22:28.845921 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46150) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:22:28.925448 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.pecan_wsgi.hooks.translation [None req-3c786998-f437-4cc1-97db-193a6ba93e13 admin admin] GET failed (client error): The resource could not be found.
May 27 09:22:28.926732 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-3c786998-f437-4cc1-97db-193a6ba93e13 admin admin] 10.222.0.30 "GET /v2.0/networks/public HTTP/1.1" status: 404  len: 314 time: 0.0798042
May 27 09:22:29.097763 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c31e6b64-db5c-4e51-a0c3-10d41fe8d1d8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:22:29.099238 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-c31e6b64-db5c-4e51-a0c3-10d41fe8d1d8 admin admin] 10.222.0.30 "GET /v2.0/networks?name=public HTTP/1.1" status: 200  len: 889 time: 0.1685712
May 27 09:22:31.283470 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46160) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:22:31.332969 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:22:31.338039 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:22:31.347867 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:22:31.357649 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Made reservation on behalf of 61d631a5c0f64cc59cd1457e62697bdf for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:22:31.360026 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:31.447739 dv-cinder-772623-6-iscsi neutron-server[91820]: WARNING neutron.services.revisions.revision_plugin [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Could not find related network for resource <neutron.db.rbac_db_models.NetworkRBAC[object at 7f2eec6dfb50] {project_id='61d631a5c0f64cc59cd1457e62697bdf', id='4147c0b6-d28e-4dbc-b200-116cc22c9df0', target_tenant='*', action='access_as_shared', object_id='046de037-2aa2-4131-9293-eb7b6b5db405'}> to bump revision.
May 27 09:22:31.461686 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] vlan segment allocate from pool success with {'vlan_id': 390, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:22:31.472390 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:31.472727 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Added segment ff06cfec-4c84-4b3f-8844-ab24b7be9cca of type vlan for network 046de037-2aa2-4131-9293-eb7b6b5db405
May 27 09:22:31.501737 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:31.534857 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:31.536269 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:22:31.536860 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:31.540511 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:22:31.642385 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Pushing event updated for resources: {'Network': ['ID=046de037-2aa2-4131-9293-eb7b6b5db405,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:22:31.646093 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 847 time: 0.3610792
May 27 09:22:31.651971 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.652345 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.652685 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.653021 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.653352 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.653688 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.654016 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.654337 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.654678 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.655004 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.655324 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.655680 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:31.665056 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:22:31.673997 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 046de037-2aa2-4131-9293-eb7b6b5db405 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:22:33.825899 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46170) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:22:33.894625 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.pecan_wsgi.hooks.translation [None req-63813bba-7380-4689-b89c-87c0526be5e4 admin admin] GET failed (client error): The resource could not be found.
May 27 09:22:33.895148 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-63813bba-7380-4689-b89c-87c0526be5e4 admin admin] Synchronizing usage tracker for tenant:61d631a5c0f64cc59cd1457e62697bdf on resource:network {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:22:33.910600 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-63813bba-7380-4689-b89c-87c0526be5e4 admin admin] Unset dirty status for tenant:61d631a5c0f64cc59cd1457e62697bdf on resource:network {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:22:33.911764 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-63813bba-7380-4689-b89c-87c0526be5e4 admin admin] 10.222.0.30 "GET /v2.0/networks/shared HTTP/1.1" status: 404  len: 314 time: 0.0849063
May 27 09:22:34.018580 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a6e0a06-1d35-49c3-bec0-2cc9d8c31b3c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:22:34.020158 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-4a6e0a06-1d35-49c3-bec0-2cc9d8c31b3c admin admin] 10.222.0.30 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200  len: 826 time: 0.1044762
May 27 09:22:34.030640 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Request body: {'subnet': {'name': 'shared-subnet', 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405', 'description': 'shared-subnet', 'cidr': '192.168.233.0/24', 'ip_version': 4}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:22:34.036368 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:22:34.047071 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:22:34.059152 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Made reservation on behalf of 61d631a5c0f64cc59cd1457e62697bdf for: {'subnet': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:22:34.061589 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:34.472379 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810'] for subnet, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:34.476858 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:22:34.556138 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e5e6c5f8-b397-4481-834c-644ad15db5e2,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:22:34.561706 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:22:34.562684 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Checking segment: {'id': 'ff06cfec-4c84-4b3f-8844-ab24b7be9cca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:22:34.563198 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Network hostable DHCP agents. Network: 046de037-2aa2-4131-9293-eb7b6b5db405, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91820) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:22:34.589207 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Network 046de037-2aa2-4131-9293-eb7b6b5db405 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91820) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:22:34.603438 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 046de037-2aa2-4131-9293-eb7b6b5db405) {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:22:34.607656 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:22:34.608245 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:34.613044 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14726d81-c6f5-4476-b18e-f094b799242b None None] Network 046de037-2aa2-4131-9293-eb7b6b5db405 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:22:34.637906 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 845 time: 0.6110480
May 27 09:22:34.868941 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp391d76a4-97d4-5c01-84fd-9bc405269bae-046de037-2aa2-4131-9293-eb7b6b5db405', 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405', 'tenant_id': '61d631a5c0f64cc59cd1457e62697bdf', 'fixed_ips': [{'subnet_id': 'e5e6c5f8-b397-4481-834c-644ad15db5e2'}]}} from dv-cinder-772623-6-iscsi. {{(pid=91822) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 27 09:22:34.869868 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:35.032643 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.db_base_plugin_common [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Allocated IP 192.168.233.2 (046de037-2aa2-4131-9293-eb7b6b5db405/e5e6c5f8-b397-4481-834c-644ad15db5e2/bea1a259-6951-4996-a5e4-98478d5ec6dd) {{(pid=91822) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:22:35.243622 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Notify callbacks [] for port, precommit_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:35.256870 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Transition to ACTIVE for port object bea1a259-6951-4996-a5e4-98478d5ec6dd will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:22:35.286939 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Transition to ACTIVE for port object bea1a259-6951-4996-a5e4-98478d5ec6dd will not be triggered until provisioned by entity DHCP. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:22:35.296283 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:35.301998 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:22:35.388222 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Network 046de037-2aa2-4131-9293-eb7b6b5db405 is already hosted by enough agents. {{(pid=91822) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:22:35.391980 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Pushing event updated for resources: {'Port': ['ID=bea1a259-6951-4996-a5e4-98478d5ec6dd,revision_number=1']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:22:35.396117 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.base_scheduler [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Resources bound (agent type, host, resource id):  {{(pid=91822) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:22:35.398523 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Received port after_create {{(pid=91822) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:22:35.405243 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.405592 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.405934 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.406266 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.406596 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.406933 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.407258 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.407610 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.407953 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.408282 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.409180 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.409648 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:22:35.413781 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:22:35.501513 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Attempting to bind port bea1a259-6951-4996-a5e4-98478d5ec6dd on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:22:35.501800 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Attempting to bind port bea1a259-6951-4996-a5e4-98478d5ec6dd by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'ff06cfec-4c84-4b3f-8844-ab24b7be9cca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:22:35.502171 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Attempting to bind port bea1a259-6951-4996-a5e4-98478d5ec6dd on network 046de037-2aa2-4131-9293-eb7b6b5db405 {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:22:35.508605 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 22, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:22:35.508986 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Checking segment: {'id': 'ff06cfec-4c84-4b3f-8844-ab24b7be9cca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:22:35.509387 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:35.509781 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Bound using segment: {'id': 'ff06cfec-4c84-4b3f-8844-ab24b7be9cca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:22:35.510256 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Bound port: bea1a259-6951-4996-a5e4-98478d5ec6dd, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ff06cfec-4c84-4b3f-8844-ab24b7be9cca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:22:35.511166 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:35.608009 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] For port bea1a259-6951-4996-a5e4-98478d5ec6dd, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:22:35.612418 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] For port bea1a259-6951-4996-a5e4-98478d5ec6dd, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=bea1a259-6951-4996-a5e4-98478d5ec6dd,segment=NetworkSegment(ff06cfec-4c84-4b3f-8844-ab24b7be9cca),segment_id=ff06cfec-4c84-4b3f-8844-ab24b7be9cca)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:22:35.617698 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:35.623179 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:22:35.711616 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Pushing event updated for resources: {'Port': ['ID=bea1a259-6951-4996-a5e4-98478d5ec6dd,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:22:35.714759 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:22:36.101375 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device bea1a259-6951-4996-a5e4-98478d5ec6dd up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:22:36.208610 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port bea1a259-6951-4996-a5e4-98478d5ec6dd completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:22:36.566500 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e7bafb0-46fe-40f2-b535-e2124f38a5f5 None None] Network 046de037-2aa2-4131-9293-eb7b6b5db405 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:22:36.673968 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-14445141-5867-4db6-929c-a0c5cdcbff77 None None] Provisioning for port bea1a259-6951-4996-a5e4-98478d5ec6dd completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:22:36.684724 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-14445141-5867-4db6-929c-a0c5cdcbff77 None None] Provisioning complete for port bea1a259-6951-4996-a5e4-98478d5ec6dd triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:22:36.685094 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-14445141-5867-4db6-929c-a0c5cdcbff77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:36.917598 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-14445141-5867-4db6-929c-a0c5cdcbff77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:36.966308 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-14445141-5867-4db6-929c-a0c5cdcbff77 None None] For port bea1a259-6951-4996-a5e4-98478d5ec6dd, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=bea1a259-6951-4996-a5e4-98478d5ec6dd,segment=NetworkSegment(ff06cfec-4c84-4b3f-8844-ab24b7be9cca),segment_id=ff06cfec-4c84-4b3f-8844-ab24b7be9cca)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:22:36.973078 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-14445141-5867-4db6-929c-a0c5cdcbff77 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:36.976991 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-610a1cc7-edb5-4c47-9f64-9f2073d7d940 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:22:37.082698 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 5 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:22:37.083291 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14445141-5867-4db6-929c-a0c5cdcbff77 None None] Pushing event updated for resources: {'Port': ['ID=bea1a259-6951-4996-a5e4-98478d5ec6dd,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:22:37.086257 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-14445141-5867-4db6-929c-a0c5cdcbff77 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:22:37.194482 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-b9e5bad5-cc3e-4d58-be39-94257434e9ce None None] Provisioning complete for port bea1a259-6951-4996-a5e4-98478d5ec6dd triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:22:37.194782 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-b9e5bad5-cc3e-4d58-be39-94257434e9ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:38.054457 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device bea1a259-6951-4996-a5e4-98478d5ec6dd up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:22:38.124027 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port bea1a259-6951-4996-a5e4-98478d5ec6dd triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:22:38.124393 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:38.470000 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-114ee86b-e5d4-474d-abb3-dde1c45f98e9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:41.429648 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:41.763809 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-520f4936-db36-4451-8e0f-9ea40bb12062 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:42.317991 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:22:44.858458 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:08.463339 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e50bd472-b6c9-43fb-ab25-f6bff396ca6d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:11.423567 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:11.766554 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-0ceff8a6-9b5d-4aeb-b5e6-007b84136d68 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:12.319874 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:14.083314 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 5 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:23:14.860589 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:38.467430 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-cb101241-6f4d-4a5a-8d75-8496f10e9c39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:41.426854 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:41.770126 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-772ada3f-c205-414d-b00c-e4343033111d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:42.324648 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:44.863306 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:49.398933 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46220) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:23:49.404960 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [None req-65711f37-afa0-409a-b690-a9aadf3fc41b tempest-verify_tempest_config-202714080 tempest-verify_tempest_config-202714080-project] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91820) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:23:49.405927 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-65711f37-afa0-409a-b690-a9aadf3fc41b tempest-verify_tempest_config-202714080 tempest-verify_tempest_config-202714080-project] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13635 time: 0.0059941
May 27 09:23:49.738220 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46238) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:23:49.862177 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:49.881195 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:23:49.886669 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Usage tracker for resource:security_group_rule and tenant:550185a42d8041e696de06065e5fb5bd is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:23:49.889963 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:23:49.895818 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:23:49.983193 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:49.987683 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:49.995307 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:23:50.036635 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e5d0e3c-1fec-49db-9372-13e08e960f89,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:23:50.040416 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=550185a42d8041e696de06065e5fb5bd&name=default HTTP/1.1" status: 200  len: 2975 time: 0.3012261
May 27 09:23:50.043161 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46244) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:23:50.046205 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.046569 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.047024 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.047360 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.047730 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.048485 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.048485 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.048718 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.049036 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.049358 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.049677 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.049993 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.053807 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:23:50.104977 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:50.130847 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:50.231913 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:50.236820 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:23:50.252109 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e5d0e3c-1fec-49db-9372-13e08e960f89,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:23:50.259525 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.259889 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.260235 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.260566 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.260896 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.261236 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.261581 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.261883 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.262210 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.262539 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.262850 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.263163 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:23:50.268110 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:23:50.269484 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:23:50.270598 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6e5d0e3c-1fec-49db-9372-13e08e960f89 HTTP/1.1" status: 204  len: 168 time: 0.2264614
May 27 09:23:51.081938 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 5 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:24:08.470922 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-c7c5c895-6c38-43ba-9749-3a0698e86039 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:24:11.433827 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:24:11.771239 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-74593f26-108a-4fe5-89dc-ebb6e62494a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:24:12.327268 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:24:14.869282 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:24:28.080689 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 5 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:24:38.473222 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1c1b3abc-84c6-4fd5-9f1b-aeaa19db07c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:24:41.427203 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:24:41.774455 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-4a3e51d1-9299-4df4-b815-19dfb2212454 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:24:42.328189 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:24:44.870649 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:05.079509 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 5 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:25:08.475596 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-43fcb47b-40bc-4214-be6a-fd60b2297cfb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:11.429566 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:11.774884 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-dd3ea798-f574-45e7-a024-9c54fb5134a0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:12.330617 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:14.872206 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:26.338430 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271'] for agent, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:30.858615 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46296) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:25:30.974872 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-6666278f-261d-4bdb-8711-280a5e94c81f admin admin] 10.222.0.30 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.1150661
May 27 09:25:33.119591 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46306) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:25:33.185699 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-9e6684a2-77c3-443f-bd41-889a520d4b0c admin admin] 10.222.0.30 "GET /v2.0/agents HTTP/1.1" status: 200  len: 4303 time: 0.0650086
May 27 09:25:38.477495 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e8cafdd8-efea-4ae6-951c-8332de6aef92 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:41.432149 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:41.778754 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-976a78f3-1c32-4632-9fc5-f2a25677fd31 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:42.079073 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:25:42.334440 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:44.876106 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:25:56.290329 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:08.480113 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-b5577ce2-7cf2-4774-84e3-121dcb03a068 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:11.434090 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:11.781154 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3a0498e0-801d-4321-85da-751056f4907a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:12.336254 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:14.880313 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:19.078864 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:26:26.294277 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:38.482062 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-8671cb4f-9129-4849-aa7f-77c0e6d0f99f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:41.437404 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:41.782996 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a32017e0-1a8e-417c-8e68-958032b2c63b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:42.340246 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:44.883581 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:26:56.077773 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:26:56.310314 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:00.419521 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46520) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:00.452754 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46526) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:00.490104 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46534) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:00.499785 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46540) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:00.535750 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46546) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:00.662511 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1212802959-network', 'tenant_id': '1e809ec6b9624e98a228033a8d2c59f1'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:00.668844 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:00.673808 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Usage tracker for resource:network and tenant:1e809ec6b9624e98a228033a8d2c59f1 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:00.676775 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:00.682635 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:00.693129 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Made reservation on behalf of 1e809ec6b9624e98a228033a8d2c59f1 for: {'network': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:00.696655 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:00.718914 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-network', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:00.725239 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:00.727705 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:00.740491 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Usage tracker for resource:network and tenant:e165c54223b24166b6856b6f285c4bca is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:00.745151 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:00.751191 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:00.753443 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:00.758306 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Usage tracker for resource:security_group_rule and tenant:1e809ec6b9624e98a228033a8d2c59f1 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:00.762782 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:00.770530 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:00.775220 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Made reservation on behalf of e165c54223b24166b6856b6f285c4bca for: {'network': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:00.777533 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:00.794803 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:00.820668 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:00.827531 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Usage tracker for resource:security_group_rule and tenant:e165c54223b24166b6856b6f285c4bca is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:00.833525 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:00.843426 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:00.884530 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1559743926-network', 'tenant_id': '0daf73d9a2424c3e9ccbe74a9d2d94f5'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:00.903408 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-905086666-network', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:00.910034 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:00.917457 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Usage tracker for resource:network and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:00.919080 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:00.923106 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:00.924423 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Usage tracker for resource:network and tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:00.927993 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:00.933526 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:00.935004 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:00.950532 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1993671404-network', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:00.963767 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Made reservation on behalf of 0daf73d9a2424c3e9ccbe74a9d2d94f5 for: {'network': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:00.963767 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:00.982175 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Made reservation on behalf of f631f0ceb250483891019fb79b2e6b83 for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:00.984546 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:00.990193 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.017546 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:01.019697 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.020968 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.021173 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:01.038850 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Usage tracker for resource:network and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:01.040077 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Usage tracker for resource:security_group_rule and tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:01.044827 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:01.047854 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.049227 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:01.052054 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:01.055086 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:01.060665 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Usage tracker for resource:security_group_rule and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:01.065726 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:01.066832 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:01.069970 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:01.074025 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:01.080171 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Made reservation on behalf of 3b2fb81840c64238b0ae0db08ca9b139 for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:01.082714 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.100823 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.114410 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] vlan segment allocate from pool success with {'vlan_id': 387, 'physical_network': 'physnet1'}  {{(pid=91821) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:27:01.119560 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:01.124880 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Usage tracker for resource:security_group_rule and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:01.128608 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:01.135800 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:01.142838 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.165389 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.166543 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.166941 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.segments_db [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Added segment 519332c4-0201-4d92-9424-ec0b1d1407e4 of type vlan for network 614fa2b9-1890-4e8d-9f9a-f79aaebf515d
May 27 09:27:01.181049 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e8bf65a1-fc64-4453-8162-f7e810f7e312,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:01.209518 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.209869 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.210082 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.210514 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.210871 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.211336 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.211799 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.212153 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.212512 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.212831 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.213176 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.213488 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Tracked resource versions report:
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]: pushed versions:
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]: {   'AddressGroup': {'1.2'},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     'ConntrackHelper': {'1.0'},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     'Log': {'1.0'},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     'Network': {'1.1'},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     'Port': {'1.7'},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     'PortForwarding': {'1.2'},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     'QosPolicy': {'1.8'},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     'SecurityGroup': {'1.4'},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     'SecurityGroupRule': {'1.2'},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     'SubPort': {'1.0'},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     'Subnet': {'1.1'},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     'Trunk': {'1.1'}}
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]: consumer versions:
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]: {   DHCP agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     HyperV agent@hv-cinder-77262: {},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     L3 agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     Metadata agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     Metering agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:     Open vSwitch agent@dv-cinder-772623-6-iscsi: {   'AddressGroup': '1.2',
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'ConntrackHelper': '1.0',
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'Log': '1.0',
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'Network': '1.1',
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'Port': '1.7',
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'PortForwarding': '1.2',
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'QosPolicy': '1.8',
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'SecurityGroup': '1.4',
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'SecurityGroupRule': '1.2',
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'SubPort': '1.0',
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'Subnet': '1.1',
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:                                                      'Trunk': '1.1'}}
May 27 09:27:01.214544 dv-cinder-772623-6-iscsi neutron-server[91821]:  {{(pid=91821) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 27 09:27:01.218381 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:01.227987 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dee008b7-a9fb-4476-b282-fdd614601a0d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.041s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:01.243188 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] vlan segment allocate from pool success with {'vlan_id': 373, 'physical_network': 'physnet1'}  {{(pid=91821) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:27:01.264557 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.289782 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.290139 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.segments_db [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Added segment bd8c1b0f-c94a-4b60-a7ce-94548ae35a54 of type vlan for network ca288a2a-9fc5-474b-a3f5-732ddd5ede80
May 27 09:27:01.343237 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b092a0d-7e7a-44dd-89d6-e037e6befb57,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:01.346660 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:01.378978 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.391920 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.397755 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.402248 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:01.402888 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.410574 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.411535 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:01.412423 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.437855 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] vlan segment allocate from pool success with {'vlan_id': 396, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:27:01.455856 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.456604 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Added segment 2a4e0452-89d7-4dda-9abd-65b3d289e707 of type vlan for network 624aa867-a71e-4343-8899-4e49257cd000
May 27 09:27:01.462066 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.467497 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.505704 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.512036 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:01.512618 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.518497 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-12813d89-4f38-47b7-a98e-2235e3794189 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:01.568930 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 885 time: 1.1482940
May 27 09:27:01.571442 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 892 time: 1.1176744
May 27 09:27:01.575291 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46584) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:01.578827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46586) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:01.591845 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Request body: {'subnet': {'network_id': '614fa2b9-1890-4e8d-9f9a-f79aaebf515d', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1212802959-subnet', 'tenant_id': '1e809ec6b9624e98a228033a8d2c59f1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:01.593277 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dead19a2-ed58-4c1b-b4be-9014768aadbd,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:01.601468 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Request body: {'subnet': {'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-subnet', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:01.606476 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Pushing event updated for resources: {'Network': ['ID=614fa2b9-1890-4e8d-9f9a-f79aaebf515d,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:01.610181 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:01.611349 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] vlan segment allocate from pool success with {'vlan_id': 386, 'physical_network': 'physnet1'}  {{(pid=91821) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:27:01.615443 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:01.616719 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.617279 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.618774 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.618774 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.619254 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.619459 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 614fa2b9-1890-4e8d-9f9a-f79aaebf515d details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:27:01.619940 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.622355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.622355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.622355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.622355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.622355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.622770 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Tracked resource versions report:
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]: pushed versions:
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]: {   'AddressGroup': {'1.2'},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     'ConntrackHelper': {'1.0'},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     'Log': {'1.0'},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     'Network': {'1.1'},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     'Port': {'1.7'},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     'PortForwarding': {'1.2'},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     'QosPolicy': {'1.8'},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     'SecurityGroup': {'1.4'},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     'SecurityGroupRule': {'1.2'},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     'SubPort': {'1.0'},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     'Subnet': {'1.1'},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     'Trunk': {'1.1'}}
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]: consumer versions:
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]: {   DHCP agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     HyperV agent@hv-cinder-77262: {},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     L3 agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     Metadata agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     Metering agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:     Open vSwitch agent@dv-cinder-772623-6-iscsi: {   'AddressGroup': '1.2',
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'ConntrackHelper': '1.0',
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'Log': '1.0',
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'Network': '1.1',
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'Port': '1.7',
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'PortForwarding': '1.2',
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'QosPolicy': '1.8',
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'SecurityGroup': '1.4',
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'SecurityGroupRule': '1.2',
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'SubPort': '1.0',
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'Subnet': '1.1',
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:                                                      'Trunk': '1.1'}}
May 27 09:27:01.624571 dv-cinder-772623-6-iscsi neutron-server[91820]:  {{(pid=91820) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 27 09:27:01.627673 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a9f7c7b9-fd21-44a9-9e6d-983262b9e1a2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.066s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:01.634522 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:01.643835 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:01.659828 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Usage tracker for resource:subnet and tenant:1e809ec6b9624e98a228033a8d2c59f1 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:01.664185 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:01.671171 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Usage tracker for resource:subnet and tenant:e165c54223b24166b6856b6f285c4bca is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:01.679717 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:01.692411 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:01.694991 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.695586 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.segments_db [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Added segment 5cc9fe82-a594-45e0-8c16-9cade14c2ef5 of type vlan for network 7cbf7538-2626-435d-83dd-e10fb0c9e965
May 27 09:27:01.697232 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:01.713118 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.716377 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:01.717625 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.789013 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:01.799446 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Made reservation on behalf of 1e809ec6b9624e98a228033a8d2c59f1 for: {'subnet': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:01.802174 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Notify callbacks [] for subnet, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.815905 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Pushing event updated for resources: {'Network': ['ID=ca288a2a-9fc5-474b-a3f5-732ddd5ede80,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:01.819363 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:01.824916 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.258s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:01.836154 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:01.848155 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 889 time: 1.3468237
May 27 09:27:01.852369 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46596) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:01.897066 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Request body: {'subnet': {'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-subnet', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:01.900771 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:27:02.041381 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.db.resource_extend [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 27 09:27:02.078962 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.082807 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48e9e898-8ba6-494b-b4a6-c29df60938f6,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:02.093812 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:02.098154 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Usage tracker for resource:subnet and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:02.101746 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:02.106906 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.108864 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:02.122080 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.297s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:02.127081 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] vlan segment allocate from pool success with {'vlan_id': 399, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:27:02.128508 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Made reservation on behalf of f631f0ceb250483891019fb79b2e6b83 for: {'subnet': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:02.132766 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Notify callbacks [] for subnet, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.136989 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.137344 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Added segment 3f4b268e-0da0-49f5-8985-9d93ceab74d6 of type vlan for network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6
May 27 09:27:02.173857 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.177538 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Pushing event updated for resources: {'Network': ['ID=624aa867-a71e-4343-8899-4e49257cd000,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:02.178953 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Made reservation on behalf of e165c54223b24166b6856b6f285c4bca for: {'subnet': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:02.182149 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.197959 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.410s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:02.198431 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-fb7263c0-bde1-422b-8438-df5e86a81238 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.026s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:02.198951 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 624aa867-a71e-4343-8899-4e49257cd000 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:27:02.208608 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.258540 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05e40f2b-819f-4024-b3b0-35e6ffb5bee9,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:02.280507 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:02.286535 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:02.287123 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.314732 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.316263 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0aa881ba-c6d8-4722-a558-f7f806be91f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:02.316700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:02.317582 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.325413 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a14423dd-e5ca-4eb1-8a67-a795b598579f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:02.451264 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Pushing event updated for resources: {'Network': ['ID=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:02.463935 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:27:02.465357 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:02.477082 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 1.9393644
May 27 09:27:02.479892 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46624) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:02.494079 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Request body: {'subnet': {'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1993671404-subnet', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:02.506309 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:02.513685 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Usage tracker for resource:subnet and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:02.521635 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:02.540018 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:02.558748 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Made reservation on behalf of 3b2fb81840c64238b0ae0db08ca9b139 for: {'subnet': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:02.560575 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 888 time: 2.0691922
May 27 09:27:02.565244 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.582543 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46630) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:02.583559 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Pushing event updated for resources: {'Network': ['ID=7cbf7538-2626-435d-83dd-e10fb0c9e965,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:02.596427 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.280s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:02.604840 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Request body: {'subnet': {'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1559743926-subnet', 'tenant_id': '0daf73d9a2424c3e9ccbe74a9d2d94f5', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:02.611773 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:02.616301 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Usage tracker for resource:subnet and tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:02.620952 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:02.628019 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:02.680353 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Made reservation on behalf of 0daf73d9a2424c3e9ccbe74a9d2d94f5 for: {'subnet': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:02.687098 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:02.722665 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 7cbf7538-2626-435d-83dd-e10fb0c9e965 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:27:03.070262 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46648) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:03.330523 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810'] for subnet, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:03.337032 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f1e03c74-02e9-4a89-ac44-da9862f20a2c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:03.401545 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:03.421386 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b2c650ce-3329-4545-aaac-c69109472b2b,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:03.424139 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:03.432235 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Checking segment: {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:03.432594 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Network hostable DHCP agents. Network: bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91820) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:27:03.450755 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91820) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:27:03.460587 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6) {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:03.466542 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:03.467195 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:03.471992 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4dea093f-6f4c-49fe-b763-2a10d4cf9462 None None] Network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:27:03.485061 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:03.494403 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.0068135
May 27 09:27:03.495409 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46664) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:03.500863 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:03.506285 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:03.511729 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Usage tracker for resource:router and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:03.515441 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Usage tracker for resource:security_group_rule and tenant:a405ab1f95de476097f49fe15fb8f456 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:03.515637 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:03.518982 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:03.522518 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:03.531023 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:03.535261 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3812772', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1963'] for router, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:03.536497 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3855012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3811180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3881146', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1952'] for router, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:03.560545 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:03.726014 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp391d76a4-97d4-5c01-84fd-9bc405269bae-bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b'}]}} from dv-cinder-772623-6-iscsi. {{(pid=91822) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 27 09:27:03.727027 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:03.901128 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.db_base_plugin_common [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Allocated IP 172.20.0.2 (bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6/b2c650ce-3329-4545-aaac-c69109472b2b/77da385f-1497-48dc-bf55-93ebb14bc441) {{(pid=91822) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:03.949031 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:03.952342 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3811195', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3812794', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2006'] for router, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:03.968909 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.030742 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:04.037104 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810'] for subnet, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.037893 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810'] for subnet, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.100371 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Synchronizing usage tracker for tenant:61d631a5c0f64cc59cd1457e62697bdf on resource:security_group {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:04.104243 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810'] for subnet, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.143984 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Notify callbacks [] for port, precommit_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.162965 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Transition to ACTIVE for port object 77da385f-1497-48dc-bf55-93ebb14bc441 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:04.189165 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9995450-9cd5-4921-8758-9e33aae9be29,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:04.198108 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Transition to ACTIVE for port object 77da385f-1497-48dc-bf55-93ebb14bc441 will not be triggered until provisioned by entity DHCP. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:04.208075 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.214227 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:04.215079 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:04.232511 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-c89519ff-143d-402a-bd65-560b5b9ed7c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.174s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:04.281492 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 is already hosted by enough agents. {{(pid=91822) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:04.284678 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.base_scheduler [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Resources bound (agent type, host, resource id):  {{(pid=91822) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:04.289895 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Received port after_create {{(pid=91822) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:04.296221 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Pushing event updated for resources: {'Port': ['ID=77da385f-1497-48dc-bf55-93ebb14bc441,revision_number=1']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:04.329464 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.347336 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.347817 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.348258 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.348692 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.349117 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.349760 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.350188 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.350641 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.351775 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.352452 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.352901 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.353321 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Tracked resource versions report:
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]: pushed versions:
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]: {   'AddressGroup': {'1.2'},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     'ConntrackHelper': {'1.0'},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     'Log': {'1.0'},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     'Network': {'1.1'},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     'Port': {'1.7'},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     'PortForwarding': {'1.2'},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     'QosPolicy': {'1.8'},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     'SecurityGroup': {'1.4'},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     'SecurityGroupRule': {'1.2'},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     'SubPort': {'1.0'},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     'Subnet': {'1.1'},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     'Trunk': {'1.1'}}
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]: consumer versions:
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]: {   DHCP agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     HyperV agent@hv-cinder-77262: {},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     L3 agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     Metadata agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     Metering agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:     Open vSwitch agent@dv-cinder-772623-6-iscsi: {   'AddressGroup': '1.2',
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'ConntrackHelper': '1.0',
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'Log': '1.0',
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'Network': '1.1',
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'Port': '1.7',
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'PortForwarding': '1.2',
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'QosPolicy': '1.8',
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'SecurityGroup': '1.4',
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'SecurityGroupRule': '1.2',
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'SubPort': '1.0',
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'Subnet': '1.1',
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:                                                      'Trunk': '1.1'}}
May 27 09:27:04.354433 dv-cinder-772623-6-iscsi neutron-server[91822]:  {{(pid=91822) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 27 09:27:04.365110 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:04.379039 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.418199 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Pushing event updated for resources: {'Subnet': ['ID=fe9e7e1e-674a-4cd2-835e-ab14693282cf,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:04.428946 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Attempting to bind port 77da385f-1497-48dc-bf55-93ebb14bc441 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:04.430089 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Attempting to bind port 77da385f-1497-48dc-bf55-93ebb14bc441 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:04.430787 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Attempting to bind port 77da385f-1497-48dc-bf55-93ebb14bc441 on network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:04.438427 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 26, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:04.439115 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Checking segment: {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:04.439521 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.440017 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Bound using segment: {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:04.440620 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Bound port: 77da385f-1497-48dc-bf55-93ebb14bc441, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:04.441154 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.619796 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Checking segment: {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:04.619796 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Network hostable DHCP agents. Network: 624aa867-a71e-4343-8899-4e49257cd000, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91821) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:27:04.630538 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Checking segment: {'id': '519332c4-0201-4d92-9424-ec0b1d1407e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '614fa2b9-1890-4e8d-9f9a-f79aaebf515d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:04.631067 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Network hostable DHCP agents. Network: 614fa2b9-1890-4e8d-9f9a-f79aaebf515d, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91821) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:27:04.672047 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Unset dirty status for tenant:61d631a5c0f64cc59cd1457e62697bdf on resource:security_group {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:04.677848 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a405ab1f95de476097f49fe15fb8f456&name=default HTTP/1.1" status: 200  len: 2975 time: 1.6014762
May 27 09:27:04.691025 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46682) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:04.712970 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] For port 77da385f-1497-48dc-bf55-93ebb14bc441, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:27:04.737312 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] For port 77da385f-1497-48dc-bf55-93ebb14bc441, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=77da385f-1497-48dc-bf55-93ebb14bc441,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:27:04.754776 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.793653 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:04.799500 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810'] for subnet, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:04.803520 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Network 624aa867-a71e-4343-8899-4e49257cd000 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91821) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:27:04.806362 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Allocated IP 172.27.1.41 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/91462db4-2b87-4eb5-a1a1-9d729d8adc42) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:04.822782 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Network 614fa2b9-1890-4e8d-9f9a-f79aaebf515d is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91821) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:27:04.890507 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Checking segment: {'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:04.890980 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Network hostable DHCP agents. Network: ca288a2a-9fc5-474b-a3f5-732ddd5ede80, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91821) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:27:04.895927 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 614fa2b9-1890-4e8d-9f9a-f79aaebf515d) {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:04.928378 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3d0b6e5-f7a0-4106-8f3e-bf402ce76ef3 None None] Network 614fa2b9-1890-4e8d-9f9a-f79aaebf515d requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:27:04.965424 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Pushing event updated for resources: {'Subnet': ['ID=77149737-85de-41af-b8e2-0509a46f467d,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:04.977942 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 624aa867-a71e-4343-8899-4e49257cd000) {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:05.002177 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Pushing event updated for resources: {'Port': ['ID=77da385f-1497-48dc-bf55-93ebb14bc441,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:05.006784 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:05.064219 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:05.065307 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.107824 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.192275 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.201198 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:05.231564 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-819b7679-1365-439d-b55b-893122ccaeac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.242942 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91821) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:27:05.252295 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-170a71ee-7cd0-48c6-8e7f-90c4b1b1c8b9 None None] Network 624aa867-a71e-4343-8899-4e49257cd000 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:27:05.302211 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:05.303362 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.370440 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:05.378252 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c132b159-09a3-435d-aed5-4566912ac8fa None None] Network 614fa2b9-1890-4e8d-9f9a-f79aaebf515d requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:27:05.382546 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Checking segment: {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:05.383136 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Network hostable DHCP agents. Network: 7cbf7538-2626-435d-83dd-e10fb0c9e965, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91821) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:27:05.385218 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:05.395092 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:05.427951 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-05d0d0d1-e469-40fe-859d-282332fba24c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 3.5660872
May 27 09:27:05.430151 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, ca288a2a-9fc5-474b-a3f5-732ddd5ede80) {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:05.435692 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:05.436918 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.460333 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46704) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:05.463950 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af3544c2-91ab-4019-89b2-2d61472af37a None None] Network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:27:05.473149 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-68316a44-11d0-474c-ba16-4447575c669c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 849 time: 3.8964016
May 27 09:27:05.481283 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 856 time: 3.8988614
May 27 09:27:05.482385 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:05.486048 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-cf568d22-20f9-4734-b2e8-79f64a8e00c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.254s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:05.493353 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:05.501298 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-819b7679-1365-439d-b55b-893122ccaeac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.533579 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46708) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:05.565057 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-router', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:05.569148 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Pushing event updated for resources: {'Port': ['ID=91462db4-2b87-4eb5-a1a1-9d729d8adc42,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:05.572974 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 1.485s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:05.653563 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:05.690756 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.489s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:05.692254 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:05.728858 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Usage tracker for resource:router and tenant:e165c54223b24166b6856b6f285c4bca is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:05.738856 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:05.746797 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Usage tracker for resource:router and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:05.751635 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:05.770695 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:05.799081 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Network 7cbf7538-2626-435d-83dd-e10fb0c9e965 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91821) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:27:05.813364 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:05.866216 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3d70d479-f390-4cd8-90ff-49a918615aa4,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:05.870062 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 7cbf7538-2626-435d-83dd-e10fb0c9e965) {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:05.871967 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3812772', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1963'] for router, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.873481 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3855012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3811180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3881146', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1952'] for router, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.877817 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.304s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:05.879777 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 1.736s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:05.879995 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:05.880626 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-819b7679-1365-439d-b55b-893122ccaeac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.883104 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:05.883809 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.888725 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.999s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:05.889120 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:05.903232 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3812772', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1963'] for router, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.904873 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-444fb323-7120-4d83-b31d-56bce0a6ae5c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:05.906173 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3855012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3811180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3881146', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1952'] for router, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.955107 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-819b7679-1365-439d-b55b-893122ccaeac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9995450-9cd5-4921-8758-9e33aae9be29,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:05.960707 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-819b7679-1365-439d-b55b-893122ccaeac admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.962634 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-819b7679-1365-439d-b55b-893122ccaeac admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c9995450-9cd5-4921-8758-9e33aae9be29 HTTP/1.1" status: 204  len: 168 time: 1.2530427
May 27 09:27:05.966217 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-819b7679-1365-439d-b55b-893122ccaeac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:05.976596 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:05.986760 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 852 time: 3.3991039
May 27 09:27:06.186764 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ead39cfa-9e61-4a34-9bad-e53b7c56da4a None None] Network 7cbf7538-2626-435d-83dd-e10fb0c9e965 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:27:06.485831 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:06.529084 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 77da385f-1497-48dc-bf55-93ebb14bc441 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:06.576552 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:06.914071 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3811195', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3812794', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2006'] for router, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:06.946434 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp391d76a4-97d4-5c01-84fd-9bc405269bae-624aa867-a71e-4343-8899-4e49257cd000', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d'}]}} from dv-cinder-772623-6-iscsi. {{(pid=91822) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 27 09:27:06.951723 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:07.028324 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a4027d5-90f5-48ab-bea8-14cec9d71488 None None] Network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:27:07.640674 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46772) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:07.646727 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:07.838401 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3811195', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3812794', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2006'] for router, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:07.840158 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:07.865390 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1f41d9e7-5537-487c-a053-105418d166dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:08.343278 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Allocated IP 172.27.1.242 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/43ed4068-0876-4362-b9a6-c0cfd260601e) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:08.442115 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 77da385f-1497-48dc-bf55-93ebb14bc441 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:08.448282 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d0a8dd0-b4bb-4424-bce5-8d0b070e501e None None] Network 7cbf7538-2626-435d-83dd-e10fb0c9e965 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:27:08.469657 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46804) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:08.484530 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-1f41d9e7-5537-487c-a053-105418d166dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:08.494954 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-1f41d9e7-5537-487c-a053-105418d166dd admin admin] Usage tracker for resource:security_group_rule and tenant:92229e60e3e54d39815fb8ab88686ce0 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:08.500617 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-1f41d9e7-5537-487c-a053-105418d166dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:08.521798 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-1f41d9e7-5537-487c-a053-105418d166dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:08.614206 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:08.627992 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46826) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:08.628639 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46828) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:08.639242 dv-cinder-772623-6-iscsi neutron-server[91821]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases.
May 27 09:27:08.653710 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 77da385f-1497-48dc-bf55-93ebb14bc441 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:08.654308 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:08.727498 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-49a1a2ef-2a5b-44af-b119-ebbd1d276d88 None None] Provisioning for port 77da385f-1497-48dc-bf55-93ebb14bc441 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:08.779084 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-49a1a2ef-2a5b-44af-b119-ebbd1d276d88 None None] Provisioning complete for port 77da385f-1497-48dc-bf55-93ebb14bc441 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:08.779755 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-49a1a2ef-2a5b-44af-b119-ebbd1d276d88 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:08.789683 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3812787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3811082'] for router, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:08.824232 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c265741-987a-4b15-b965-97e83a403556 None None] Network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:27:08.847920 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e7587552-f67a-4847-9aec-69b8974f4b83 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:08.888808 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e7587552-f67a-4847-9aec-69b8974f4b83 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:08.896816 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e7587552-f67a-4847-9aec-69b8974f4b83 admin admin] Usage tracker for resource:security_group_rule and tenant:db47e1468de048dbaab7c1926baf5227 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:08.908935 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e7587552-f67a-4847-9aec-69b8974f4b83 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:08.922222 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-89873ab9-67d9-4ce4-b5c1-8ecf50868b93 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:08.923064 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-89873ab9-67d9-4ce4-b5c1-8ecf50868b93 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Synchronizing usage tracker for tenant:1e809ec6b9624e98a228033a8d2c59f1 on resource:network {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:09.039839 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e7587552-f67a-4847-9aec-69b8974f4b83 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:09.044699 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-89873ab9-67d9-4ce4-b5c1-8ecf50868b93 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Unset dirty status for tenant:1e809ec6b9624e98a228033a8d2c59f1 on resource:network {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:09.045516 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-89873ab9-67d9-4ce4-b5c1-8ecf50868b93 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/networks?id=614fa2b9-1890-4e8d-9f9a-f79aaebf515d HTTP/1.1" status: 200  len: 812 time: 0.4101977
May 27 09:27:09.126229 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-1ec2c8ab-14b6-4455-ac0f-dc36640c4ff1 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:09.127038 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-1ec2c8ab-14b6-4455-ac0f-dc36640c4ff1 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Synchronizing usage tracker for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:network {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:09.160348 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1f41d9e7-5537-487c-a053-105418d166dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:09.165590 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-49ac71eb-5484-4d72-9e24-388a4ab785a3 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/quotas/1e809ec6b9624e98a228033a8d2c59f1 HTTP/1.1" status: 200  len: 375 time: 0.1092198
May 27 09:27:09.168110 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-1ec2c8ab-14b6-4455-ac0f-dc36640c4ff1 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Unset dirty status for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:network {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:09.169188 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-1ec2c8ab-14b6-4455-ac0f-dc36640c4ff1 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 815 time: 0.5356755
May 27 09:27:09.171444 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1f41d9e7-5537-487c-a053-105418d166dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:09.206725 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:09.242274 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-1f41d9e7-5537-487c-a053-105418d166dd admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=92229e60e3e54d39815fb8ab88686ce0&name=default HTTP/1.1" status: 200  len: 2975 time: 1.4520130
May 27 09:27:09.246071 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f41d9e7-5537-487c-a053-105418d166dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a03ce28f-ce2b-4217-b95a-436f2167d0d0,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:09.248991 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46852) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:09.317968 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-96ff141b-48ad-49f3-8b0a-54d098e313b6 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=1e809ec6b9624e98a228033a8d2c59f1&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1149378
May 27 09:27:09.321709 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-1f41d9e7-5537-487c-a053-105418d166dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:09.344298 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e7d7c2e8-15f5-4992-b4c5-d3ec34339350 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/quotas/0daf73d9a2424c3e9ccbe74a9d2d94f5 HTTP/1.1" status: 200  len: 375 time: 0.1401172
May 27 09:27:09.380133 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:09.483918 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ee6f9315-2c9e-46a0-a4f2-36a61be4d658 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:09.561969 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-de65050e-b358-4a4b-806c-9ac7279acfef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:09.605527 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-99b891d9-5142-4b83-a017-92562fdcd703 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&fields=id HTTP/1.1" status: 200  len: 210 time: 0.2085793
May 27 09:27:09.670517 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ba047552-e265-445b-96f9-0018b1d7bc66 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:09.737094 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:09.743974 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:09.745572 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:09.748616 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:09.768056 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e7587552-f67a-4847-9aec-69b8974f4b83 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:09.792824 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Router ad64253e-1ce7-4c03-90db-1073e41e8e5f is scheduled to L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 with binding_index 1 {{(pid=91820) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 27 09:27:09.795208 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.db_base_plugin_common [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Allocated IP 172.20.0.2 (624aa867-a71e-4343-8899-4e49257cd000/77149737-85de-41af-b8e2-0509a46f467d/437357ea-4e83-4e78-98c2-68e1309e808d) {{(pid=91822) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:09.808747 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e7587552-f67a-4847-9aec-69b8974f4b83 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:09.924841 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:09.947505 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-e7587552-f67a-4847-9aec-69b8974f4b83 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=db47e1468de048dbaab7c1926baf5227&name=default HTTP/1.1" status: 200  len: 2975 time: 1.4620430
May 27 09:27:09.974796 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46882) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:10.010472 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-970b0987-d668-4615-9bdb-5e170a92ba0f service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91821) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:27:10.027097 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-970b0987-d668-4615-9bdb-5e170a92ba0f service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.3707361
May 27 09:27:10.119092 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-5b44130e-3645-49d3-82d5-a67f8caf3d61 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91821) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:27:10.120316 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-5b44130e-3645-49d3-82d5-a67f8caf3d61 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.2251599
May 27 09:27:10.138889 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 77da385f-1497-48dc-bf55-93ebb14bc441, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=77da385f-1497-48dc-bf55-93ebb14bc441,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:10.182732 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ba047552-e265-445b-96f9-0018b1d7bc66 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.189891 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Pushing event updated for resources: {'Port': ['ID=43ed4068-0876-4362-b9a6-c0cfd260601e,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:10.201761 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.640s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:10.231447 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-49a1a2ef-2a5b-44af-b119-ebbd1d276d88 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.237765 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.299832 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.308080 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7587552-f67a-4847-9aec-69b8974f4b83 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44eccbe5-cb6f-4b31-ace8-6cfd5b5123ed,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:10.337292 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.355807 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e7587552-f67a-4847-9aec-69b8974f4b83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.431s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:10.361215 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:10.377516 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:27:10.391849 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Sync routers for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:27:10.403577 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:10.404397 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eece9cbb0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:26:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:10.415009 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4423bd47-1f60-4a7a-aadb-f04f85312a57 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.450165 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=77da385f-1497-48dc-bf55-93ebb14bc441,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:10.500482 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:10.595443 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.db.api [None req-49a1a2ef-2a5b-44af-b119-ebbd1d276d88 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=91822) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 27 09:27:10.596101 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_db.api [None req-49a1a2ef-2a5b-44af-b119-ebbd1d276d88 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 27 09:27:10.597132 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Notify callbacks [] for port, precommit_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.613167 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:10.686340 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4423bd47-1f60-4a7a-aadb-f04f85312a57 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.715920 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Notify callbacks [] for router, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.721918 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201  len: 922 time: 7.2208858
May 27 09:27:10.732464 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 46888) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:10.751460 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-e764bd35-a3b8-42f8-b927-13b814c96070 service neutron] 10.222.0.30 "GET /v2.0/networks/614fa2b9-1890-4e8d-9f9a-f79aaebf515d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.6958935
May 27 09:27:10.776148 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-2a7843f0-332a-40d7-b5a7-639c28e92b2c service neutron] 10.222.0.30 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5703139
May 27 09:27:10.791283 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Transition to ACTIVE for port object 437357ea-4e83-4e78-98c2-68e1309e808d will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:10.812522 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Transition to ACTIVE for port object 437357ea-4e83-4e78-98c2-68e1309e808d will not be triggered until provisioned by entity DHCP. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:10.822523 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.837495 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-610a1cc7-edb5-4c47-9f64-9f2073d7d940 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:10.861835 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ba047552-e265-445b-96f9-0018b1d7bc66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.900300 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Network 624aa867-a71e-4343-8899-4e49257cd000 is already hosted by enough agents. {{(pid=91822) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:10.907623 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4423bd47-1f60-4a7a-aadb-f04f85312a57 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:10.911537 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.base_scheduler [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Resources bound (agent type, host, resource id):  {{(pid=91822) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:10.923284 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Received port after_create {{(pid=91822) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:10.925125 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Allocated IP 172.27.1.89 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/8262e930-0850-4885-81df-37a7db4afa6d) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:10.941378 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e7587552-f67a-4847-9aec-69b8974f4b83 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:10.971835 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:10.990693 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eece9cbb0>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:05Z', 'revision_number': 3, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:04Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:10.998782 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Checking router: ad64253e-1ce7-4c03-90db-1073e41e8e5f for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:27:10.999349 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Updating router ad64253e-1ce7-4c03-90db-1073e41e8e5f port 91462db4-2b87-4eb5-a1a1-9d729d8adc42 binding host dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:27:11.057284 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4423bd47-1f60-4a7a-aadb-f04f85312a57 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44eccbe5-cb6f-4b31-ace8-6cfd5b5123ed,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:11.059965 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:11.068527 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4423bd47-1f60-4a7a-aadb-f04f85312a57 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:11.101042 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4423bd47-1f60-4a7a-aadb-f04f85312a57 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:11.108384 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-4423bd47-1f60-4a7a-aadb-f04f85312a57 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/44eccbe5-cb6f-4b31-ace8-6cfd5b5123ed HTTP/1.1" status: 204  len: 168 time: 1.1243074
May 27 09:27:11.267040 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Pushing event updated for resources: {'Port': ['ID=437357ea-4e83-4e78-98c2-68e1309e808d,revision_number=1']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:11.312882 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.475s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:11.368662 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Attempting to bind port 437357ea-4e83-4e78-98c2-68e1309e808d on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:11.369298 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Attempting to bind port 437357ea-4e83-4e78-98c2-68e1309e808d by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:11.369900 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Attempting to bind port 437357ea-4e83-4e78-98c2-68e1309e808d on network 624aa867-a71e-4343-8899-4e49257cd000 {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:11.380291 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 26, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:11.380899 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Checking segment: {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:11.381676 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:11.383049 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Bound using segment: {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:11.383985 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Bound port: 437357ea-4e83-4e78-98c2-68e1309e808d, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:11.384546 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:11.429556 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:11.502424 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-389ad11b-f037-4689-9509-34e378763bd4 service neutron] 10.222.0.30 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6791897
May 27 09:27:11.518838 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] For port 437357ea-4e83-4e78-98c2-68e1309e808d, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:27:11.524404 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] For port 437357ea-4e83-4e78-98c2-68e1309e808d, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=437357ea-4e83-4e78-98c2-68e1309e808d,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:27:11.555486 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:11.570813 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba047552-e265-445b-96f9-0018b1d7bc66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a03ce28f-ce2b-4217-b95a-436f2167d0d0,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:11.574414 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ba047552-e265-445b-96f9-0018b1d7bc66 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.603s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:11.581399 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ba047552-e265-445b-96f9-0018b1d7bc66 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:11.582958 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-ba047552-e265-445b-96f9-0018b1d7bc66 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a03ce28f-ce2b-4217-b95a-436f2167d0d0 HTTP/1.1" status: 204  len: 168 time: 2.2692277
May 27 09:27:11.656652 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:11.689065 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-d10e6686-e115-479e-86a6-f7276dbc2236 service neutron] 10.222.0.30 "GET /v2.0/networks/614fa2b9-1890-4e8d-9f9a-f79aaebf515d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.9049323
May 27 09:27:11.692493 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 46908) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:11.787948 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-add60190-b6e6-49c6-94ee-f34edf1431bb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:11.815785 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-add60190-b6e6-49c6-94ee-f34edf1431bb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:11.823100 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-add60190-b6e6-49c6-94ee-f34edf1431bb admin admin] Usage tracker for resource:security_group_rule and tenant:6f574f82882948b98a14c791754fc689 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:11.829518 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-add60190-b6e6-49c6-94ee-f34edf1431bb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:11.840652 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-add60190-b6e6-49c6-94ee-f34edf1431bb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:11.863693 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-0d63472c-3d4e-45a6-b43c-8c4ddec8f9d6 None None] Provisioning complete for port 77da385f-1497-48dc-bf55-93ebb14bc441 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:11.864596 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-0d63472c-3d4e-45a6-b43c-8c4ddec8f9d6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:12.084098 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Pushing event updated for resources: {'Port': ['ID=437357ea-4e83-4e78-98c2-68e1309e808d,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:12.108589 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.452s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:12.124914 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:12.182317 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:12.185555 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ebc45587-b1ef-4a8f-89a7-ef9f646992bf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:12.246814 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-286c9af0-5d64-4368-bfb2-b1bc877feec8 req-45ffb7bf-62ca-4b73-b5ed-aa505bcd83a4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 210 time: 0.2200336
May 27 09:27:12.422310 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:12.482658 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:12.512370 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 77da385f-1497-48dc-bf55-93ebb14bc441 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:12.743993 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 77da385f-1497-48dc-bf55-93ebb14bc441 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:12.745012 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:12.838533 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3812787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3811082'] for router, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:12.891480 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Allocated IP 172.20.0.1 (bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6/b2c650ce-3329-4545-aaac-c69109472b2b/b018c078-86c3-4e4a-bd90-fa725cdd3369) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:13.013399 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:13.166487 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f81c0a46-a102-443c-b48a-e425e797e274 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:13.587767 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:13.613425 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:13.624687 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:13.743589 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6002f8eb-cd6e-4a38-863c-1862aa4ebe9c req-286b5f1e-2c3b-4d1d-ad8e-5e9536af4db4 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 210 time: 0.8898890
May 27 09:27:13.826789 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e6cfc438-71f6-4f5c-bc91-d7b9fb305b6a req-8762c110-9c8f-4d60-a7c1-bba2c7beedfc tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 210 time: 0.1196668
May 27 09:27:13.833654 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-add60190-b6e6-49c6-94ee-f34edf1431bb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:13.865988 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-add60190-b6e6-49c6-94ee-f34edf1431bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:13.915307 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:13.920453 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Pushing event updated for resources: {'Port': ['ID=8262e930-0850-4885-81df-37a7db4afa6d,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:13.931250 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-add60190-b6e6-49c6-94ee-f34edf1431bb admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6f574f82882948b98a14c791754fc689&name=default HTTP/1.1" status: 200  len: 2975 time: 2.2380259
May 27 09:27:13.976876 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47010) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:14.011842 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 is scheduled to L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 with binding_index 1 {{(pid=91821) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 27 09:27:14.086600 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Notify callbacks [] for port, precommit_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:14.168406 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.provisioning_blocks [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Transition to ACTIVE for port object 91462db4-2b87-4eb5-a1a1-9d729d8adc42 will not be triggered until provisioned by entity L2. {{(pid=91823) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:14.191622 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:14.199068 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:14.279135 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.113s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:14.311878 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcb5b48d-c517-4f3d-9620-bbecebe6a9ff None None] Network 624aa867-a71e-4343-8899-4e49257cd000 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:27:14.349074 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Pushing event updated for resources: {'Port': ['ID=91462db4-2b87-4eb5-a1a1-9d729d8adc42,revision_number=2']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:14.386786 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-add60190-b6e6-49c6-94ee-f34edf1431bb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b26aad5-44f8-40c3-b163-0fb1fc7c0ccb,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:14.394347 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.394680 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.396670 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-add60190-b6e6-49c6-94ee-f34edf1431bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.481s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:14.400517 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.402090 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.402441 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.402861 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.403199 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.406112 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.406488 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.409108 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.409506 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.409847 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Tracked resource versions report:
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]: pushed versions:
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]: {   'AddressGroup': {'1.2'},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     'ConntrackHelper': {'1.0'},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     'Log': {'1.0'},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     'Network': {'1.1'},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     'Port': {'1.7'},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     'PortForwarding': {'1.2'},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     'QosPolicy': {'1.8'},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     'SecurityGroup': {'1.4'},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     'SecurityGroupRule': {'1.2'},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     'SubPort': {'1.0'},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     'Subnet': {'1.1'},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     'Trunk': {'1.1'}}
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]: consumer versions:
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]: {   DHCP agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     HyperV agent@hv-cinder-77262: {},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     L3 agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     Metadata agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     Metering agent@dv-cinder-772623-6-iscsi: {},
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:     Open vSwitch agent@dv-cinder-772623-6-iscsi: {   'AddressGroup': '1.2',
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'ConntrackHelper': '1.0',
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'Log': '1.0',
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'Network': '1.1',
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'Port': '1.7',
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'PortForwarding': '1.2',
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'QosPolicy': '1.8',
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'SecurityGroup': '1.4',
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'SecurityGroupRule': '1.2',
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'SubPort': '1.0',
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'Subnet': '1.1',
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:                                                      'Trunk': '1.1'}}
May 27 09:27:14.415536 dv-cinder-772623-6-iscsi neutron-server[91823]:  {{(pid=91823) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}}
May 27 09:27:14.424469 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:14.432051 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Attempting to bind port 91462db4-2b87-4eb5-a1a1-9d729d8adc42 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:14.433573 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Attempting to bind port 91462db4-2b87-4eb5-a1a1-9d729d8adc42 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:14.434734 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Attempting to bind port 91462db4-2b87-4eb5-a1a1-9d729d8adc42 on network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:14.468538 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:14.469440 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Checking segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91823) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:14.470767 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:14.474863 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Bound using segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:14.478579 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Bound port: 91462db4-2b87-4eb5-a1a1-9d729d8adc42, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:14.487731 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:14.509257 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:14.531416 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Transition to ACTIVE for port object b018c078-86c3-4e4a-bd90-fa725cdd3369 will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:14.561600 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:14.580792 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:14.700188 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:27:14.724216 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:14.764044 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ffb75d7d-9675-4138-bc5c-75ba91224a36 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:14.805879 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Sync routers for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:27:14.821031 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 437357ea-4e83-4e78-98c2-68e1309e808d up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:14.842814 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ffb75d7d-9675-4138-bc5c-75ba91224a36 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:14.846289 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] For port 91462db4-2b87-4eb5-a1a1-9d729d8adc42, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91823) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:27:14.855093 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] For port 91462db4-2b87-4eb5-a1a1-9d729d8adc42, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=91462db4-2b87-4eb5-a1a1-9d729d8adc42,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91823) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:27:14.868998 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:14.880333 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:14.904572 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:14.917759 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-6347918b-6b07-4cfd-a832-1d0e4ebaeef6 None None] Provisioning for port 437357ea-4e83-4e78-98c2-68e1309e808d completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:14.930763 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:14.931704 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3816556'] for router_interface, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:15.053464 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Pushing event updated for resources: {'Port': ['ID=b018c078-86c3-4e4a-bd90-fa725cdd3369,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:15.090115 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:15.091784 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec9e1880>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:27:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:15.127253 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.541s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:15.162437 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:15.166157 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eece9cbb0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:27:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:15.190516 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e291a732-bfc7-432e-abb5-59d6867974be req-cada1cab-0f32-452f-909a-bb2bd21ad525 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 210 time: 0.1666279
May 27 09:27:15.201154 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Notify callbacks [] for router, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:15.207807 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201  len: 928 time: 9.7329769
May 27 09:27:15.218437 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 47076) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:15.218730 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ffb75d7d-9675-4138-bc5c-75ba91224a36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:15.415924 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c168e482-6b53-41bd-9842-a5f67f29816f req-765b474d-a46c-4330-b0fd-77a57679f403 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 210 time: 0.2229109
May 27 09:27:15.434239 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:15.436270 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:15.477110 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffb75d7d-9675-4138-bc5c-75ba91224a36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b26aad5-44f8-40c3-b163-0fb1fc7c0ccb,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:15.499711 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ffb75d7d-9675-4138-bc5c-75ba91224a36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:15.518473 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ffb75d7d-9675-4138-bc5c-75ba91224a36 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:15.522349 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-ffb75d7d-9675-4138-bc5c-75ba91224a36 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2b26aad5-44f8-40c3-b163-0fb1fc7c0ccb HTTP/1.1" status: 204  len: 168 time: 1.5387454
May 27 09:27:15.671764 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-96a9b4f5-afd5-4e9f-8218-510c0973f462 None None] Provisioning for port b018c078-86c3-4e4a-bd90-fa725cdd3369 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:15.707993 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:15.810514 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 437357ea-4e83-4e78-98c2-68e1309e808d completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:15.825757 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-96a9b4f5-afd5-4e9f-8218-510c0973f462 None None] Provisioning complete for port b018c078-86c3-4e4a-bd90-fa725cdd3369 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:15.826543 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-96a9b4f5-afd5-4e9f-8218-510c0973f462 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:16.039957 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-96a9b4f5-afd5-4e9f-8218-510c0973f462 None None] Port b018c078-86c3-4e4a-bd90-fa725cdd3369 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:27:16.136543 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 437357ea-4e83-4e78-98c2-68e1309e808d triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:16.145360 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:16.323563 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Pushing event updated for resources: {'Port': ['ID=91462db4-2b87-4eb5-a1a1-9d729d8adc42,revision_number=3']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:16.324054 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:16.342201 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eece9cbb0>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:05Z', 'revision_number': 3, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:16.344987 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.441s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:16.365168 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae59bc31-89a6-4ee3-9025-c24f6dc69c2b None None] The sync data for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi is: [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:05Z', 'revision_number': 3, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:27:16.543106 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:17.214230 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.11', 57340) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:17.327992 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d4bf214b-f684-4702-8259-f19ad9b8d165 req-1c028270-eb70-4720-83d5-80ea00a6191d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 210 time: 0.4333963
May 27 09:27:17.581045 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:17.715893 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-631d0240-6dea-4825-aa06-d5672360d626 req-fa79cc2f-62e5-4346-b706-f1e557be03b7 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 210 time: 0.3857033
May 27 09:27:17.753331 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 437357ea-4e83-4e78-98c2-68e1309e808d, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=437357ea-4e83-4e78-98c2-68e1309e808d,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:17.786051 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:17.798041 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:17.955333 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=437357ea-4e83-4e78-98c2-68e1309e808d,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:17.963740 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:18.001281 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec9e1880>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:10Z', 'revision_number': 3, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:18.008776 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Checking router: a7747f73-c1a4-4a6c-8c93-cf80d93a5583 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:27:18.009360 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Updating router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 port 43ed4068-0876-4362-b9a6-c0cfd260601e binding host dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:27:18.163840 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 91462db4-2b87-4eb5-a1a1-9d729d8adc42 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:18.312720 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:18.521172 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:18.533875 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-b60a511e-0bbd-4d6c-911d-02ca560415ca None None] Provisioning complete for port 437357ea-4e83-4e78-98c2-68e1309e808d triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:18.534380 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-b60a511e-0bbd-4d6c-911d-02ca560415ca None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:18.566174 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.11', 57350) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:18.737218 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 91462db4-2b87-4eb5-a1a1-9d729d8adc42 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:18.769832 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 91462db4-2b87-4eb5-a1a1-9d729d8adc42 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:18.774396 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:19.229763 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-29590234-0889-47b9-ad39-26521c2bc4d8 req-53eea026-e5c1-44ca-bc34-e0016a16d9ac tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 210 time: 0.5587845
May 27 09:27:19.366763 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e7d2e544-9210-4723-b265-32cd3f66a876 req-8c4eaf76-0191-4b91-9b24-3c7bc8957c40 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 210 time: 0.1296325
May 27 09:27:19.582178 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-82f4dbac-d6e5-46bf-8b5e-58838bd68217 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:19.584926 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-82f4dbac-d6e5-46bf-8b5e-58838bd68217 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 815 time: 1.0159283
May 27 09:27:19.636325 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Request body: {'port': {'device_id': '771c169e-ea25-4862-a057-69f990bb8eab', 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965', 'admin_state_up': True, 'tenant_id': '0daf73d9a2424c3e9ccbe74a9d2d94f5'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:19.986948 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Notify callbacks [] for port, precommit_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:20.037357 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Transition to ACTIVE for port object 43ed4068-0876-4362-b9a6-c0cfd260601e will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:20.075644 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:20.076484 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:20.120152 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 91462db4-2b87-4eb5-a1a1-9d729d8adc42, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=91462db4-2b87-4eb5-a1a1-9d729d8adc42,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:20.142678 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-e866810f-8f29-4d8e-8201-03f952e792db None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:20.232717 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:20.385525 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:20.407153 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Usage tracker for resource:port and tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:20.420994 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:20.449695 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Attempting to bind port 43ed4068-0876-4362-b9a6-c0cfd260601e on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:20.451980 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Attempting to bind port 43ed4068-0876-4362-b9a6-c0cfd260601e by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:20.452266 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:20.452750 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Attempting to bind port 43ed4068-0876-4362-b9a6-c0cfd260601e on network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:20.495213 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:20.499849 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Checking segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:20.502677 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:20.504363 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Bound using segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:20.508224 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Bound port: 43ed4068-0876-4362-b9a6-c0cfd260601e, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:20.509826 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:20.515045 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Made reservation on behalf of 0daf73d9a2424c3e9ccbe74a9d2d94f5 for: {'port': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:20.521467 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:20.667652 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 437357ea-4e83-4e78-98c2-68e1309e808d up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:20.777067 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adfaba07-d126-4643-ba33-7aead246af3c None None] Pushing event updated for resources: {'Port': ['ID=43ed4068-0876-4362-b9a6-c0cfd260601e,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:20.784369 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-adfaba07-d126-4643-ba33-7aead246af3c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.642s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:20.797347 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.484s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:20.815234 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-903318a9-5643-4925-9975-a9cbd0a17fa9 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:20.818216 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-903318a9-5643-4925-9975-a9cbd0a17fa9 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.11 "GET /v2.0/networks?id=614fa2b9-1890-4e8d-9f9a-f79aaebf515d HTTP/1.1" status: 200  len: 812 time: 3.4591856
May 27 09:27:20.876068 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-165a0a4b-4456-4652-a064-04b09635176a req-d9892c03-0317-4a89-bb46-09d816f5db1d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 210 time: 0.1421914
May 27 09:27:20.898157 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=91462db4-2b87-4eb5-a1a1-9d729d8adc42,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:20.902885 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:20.978368 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Request body: {'port': {'device_id': 'cf0e942c-e831-44eb-9aad-239ffadc6bbe', 'network_id': '614fa2b9-1890-4e8d-9f9a-f79aaebf515d', 'admin_state_up': True, 'tenant_id': '1e809ec6b9624e98a228033a8d2c59f1'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:21.050001 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] For port 43ed4068-0876-4362-b9a6-c0cfd260601e, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:27:21.058746 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] For port 43ed4068-0876-4362-b9a6-c0cfd260601e, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=43ed4068-0876-4362-b9a6-c0cfd260601e,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:27:21.063026 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 437357ea-4e83-4e78-98c2-68e1309e808d triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:21.063690 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:21.137049 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:21.144290 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:21.225283 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2a207f38-0048-48af-a263-75077d0e7a9f req-4057ff6a-cf3c-4bb3-8f17-adfec6a41803 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 210 time: 0.3433926
May 27 09:27:21.365700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:21.418569 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:21.455035 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:21.457303 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec9e1880>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:27:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:21.508336 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Allocated IP 172.20.0.9 (7cbf7538-2626-435d-83dd-e10fb0c9e965/3d70d479-f390-4cd8-90ff-49a918615aa4/2890994f-299e-4a4d-8e0a-945b6c38ecfe) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:21.541526 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3683833', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3816655'] for router_interface, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:21.589882 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5407b5e9-eeb9-481e-8b84-35bb5d4ac8e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:21.893486 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:22.072181 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:22.089530 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:22.134951 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3812787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3811082'] for router, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:22.227349 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:22.252479 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:22.301342 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Pushing event updated for resources: {'Port': ['ID=b018c078-86c3-4e4a-bd90-fa725cdd3369,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:22.332422 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.743s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:22.797444 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Network 7cbf7538-2626-435d-83dd-e10fb0c9e965 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:22.832561 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:22.844255 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:22.853067 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:22.853991 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:22.907705 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47250) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:23.055625 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Pushing event updated for resources: {'Port': ['ID=2890994f-299e-4a4d-8e0a-945b6c38ecfe,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:23.070116 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.817s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:23.119420 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3ce9d014-ba8f-474f-89c3-44f0719b4ab6 req-4ef3fae5-e9fd-40d9-b37f-df487d50a424 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 210 time: 0.3245091
May 27 09:27:23.155906 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 3.5234635
May 27 09:27:23.276697 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00e58b31-b053-4c55-9449-9432ec4ecaf5 req-3580ec45-fb0a-4bac-b92b-3c9bcae616a0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:23.279880 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-00e58b31-b053-4c55-9449-9432ec4ecaf5 req-3580ec45-fb0a-4bac-b92b-3c9bcae616a0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Synchronizing usage tracker for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:23.294290 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adfaba07-d126-4643-ba33-7aead246af3c None None] Pushing event updated for resources: {'Port': ['ID=43ed4068-0876-4362-b9a6-c0cfd260601e,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:23.315881 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-adfaba07-d126-4643-ba33-7aead246af3c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 2.171s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:23.352675 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-00e58b31-b053-4c55-9449-9432ec4ecaf5 req-3580ec45-fb0a-4bac-b92b-3c9bcae616a0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Unset dirty status for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:23.355213 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-00e58b31-b053-4c55-9449-9432ec4ecaf5 req-3580ec45-fb0a-4bac-b92b-3c9bcae616a0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 931 time: 0.9203022
May 27 09:27:23.512098 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e9f16f66-81fc-4312-aaa8-f7b3aaafb412 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91821) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:27:23.514046 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-e9f16f66-81fc-4312-aaa8-f7b3aaafb412 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0227959
May 27 09:27:23.588924 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-00e58b31-b053-4c55-9449-9432ec4ecaf5 req-1722c710-a1b2-4a9e-a111-bf5efe6969b0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Synchronizing usage tracker for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:security_group {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:23.595441 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 91462db4-2b87-4eb5-a1a1-9d729d8adc42 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:23.698857 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Allocated IP 172.20.0.1 (624aa867-a71e-4343-8899-4e49257cd000/77149737-85de-41af-b8e2-0509a46f467d/7515b299-be21-49ae-9c90-975237275947) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:23.784999 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-562077f1-fc2e-43a8-9727-25daecb39e0c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:23.801505 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec9e1880>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:10Z', 'revision_number': 3, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:23.812317 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4716038f-206d-4e8b-9986-bbbc33a94d8f None None] The sync data for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi is: [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:10Z', 'revision_number': 3, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:27:23.816617 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 91462db4-2b87-4eb5-a1a1-9d729d8adc42 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:23.817263 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:23.821344 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-00e58b31-b053-4c55-9449-9432ec4ecaf5 req-1722c710-a1b2-4a9e-a111-bf5efe6969b0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Unset dirty status for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:security_group {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:23.824334 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-00e58b31-b053-4c55-9449-9432ec4ecaf5 req-1722c710-a1b2-4a9e-a111-bf5efe6969b0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4499357
May 27 09:27:23.841410 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-562077f1-fc2e-43a8-9727-25daecb39e0c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:23.852244 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-562077f1-fc2e-43a8-9727-25daecb39e0c admin admin] Usage tracker for resource:security_group_rule and tenant:336b6c950b95410585c953c0eea085f0 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:23.859653 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-562077f1-fc2e-43a8-9727-25daecb39e0c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:23.874173 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-562077f1-fc2e-43a8-9727-25daecb39e0c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:24.059680 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Request body: {'port': {'device_id': '771c169e-ea25-4862-a057-69f990bb8eab', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:24.112826 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:24.122480 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:24.168359 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Usage tracker for resource:port and tenant:1e809ec6b9624e98a228033a8d2c59f1 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:24.192940 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:24.284310 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:24.332105 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:24.344738 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-562077f1-fc2e-43a8-9727-25daecb39e0c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:24.353773 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:24.358358 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Transition to ACTIVE for port object 7515b299-be21-49ae-9c90-975237275947 will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:24.413948 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:24.462308 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-562077f1-fc2e-43a8-9727-25daecb39e0c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:24.543540 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Made reservation on behalf of 1e809ec6b9624e98a228033a8d2c59f1 for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:24.570777 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:24.689297 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:24.730795 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cc335a43-f0bb-451a-9402-3034ca55ef3d req-7d08d377-eec6-4c3e-8b70-dd035b9b2456 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 210 time: 0.1332326
May 27 09:27:24.828018 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-562077f1-fc2e-43a8-9727-25daecb39e0c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=336b6c950b95410585c953c0eea085f0&name=default HTTP/1.1" status: 200  len: 2979 time: 1.9135292
May 27 09:27:24.899485 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-562077f1-fc2e-43a8-9727-25daecb39e0c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6094bcd6-cfad-4f12-9c5f-f758f65288de,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:24.930630 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47270) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:25.040497 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-562077f1-fc2e-43a8-9727-25daecb39e0c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.351s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:25.070282 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 is scheduled to L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 with binding_index 1 {{(pid=91820) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 27 09:27:25.128350 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-992758bf-0a0c-4fb7-9285-4f66e0095180 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:25.190642 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-0fd718b4-2a89-4bf9-b7fc-74f31f7d3fc8 None None] Provisioning complete for port b018c078-86c3-4e4a-bd90-fa725cdd3369 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:25.196449 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-0fd718b4-2a89-4bf9-b7fc-74f31f7d3fc8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:25.330311 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-0fd718b4-2a89-4bf9-b7fc-74f31f7d3fc8 None None] Port b018c078-86c3-4e4a-bd90-fa725cdd3369 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:27:25.422385 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-992758bf-0a0c-4fb7-9285-4f66e0095180 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:25.489392 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 43ed4068-0876-4362-b9a6-c0cfd260601e up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:25.883333 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 43ed4068-0876-4362-b9a6-c0cfd260601e completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:25.907942 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 43ed4068-0876-4362-b9a6-c0cfd260601e triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:25.908664 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:26.036819 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2890994f-299e-4a4d-8e0a-945b6c38ecfe {{(pid=91821) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:27:26.061685 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:26.110139 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Transition to ACTIVE for port object 2890994f-299e-4a4d-8e0a-945b6c38ecfe will not be triggered until provisioned by entity L2. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:26.135210 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-992758bf-0a0c-4fb7-9285-4f66e0095180 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:26.136239 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:26.154803 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:26.331574 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-992758bf-0a0c-4fb7-9285-4f66e0095180 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6094bcd6-cfad-4f12-9c5f-f758f65288de,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:26.336765 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-992758bf-0a0c-4fb7-9285-4f66e0095180 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:26.347173 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-992758bf-0a0c-4fb7-9285-4f66e0095180 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:26.348383 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-992758bf-0a0c-4fb7-9285-4f66e0095180 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6094bcd6-cfad-4f12-9c5f-f758f65288de HTTP/1.1" status: 204  len: 168 time: 1.4142532
May 27 09:27:26.369127 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.200s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:26.374583 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:26.400821 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:26.424747 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 43ed4068-0876-4362-b9a6-c0cfd260601e, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=43ed4068-0876-4362-b9a6-c0cfd260601e,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:26.431936 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:26.444851 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-14445141-5867-4db6-929c-a0c5cdcbff77 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:26.620726 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Pushing event updated for resources: {'Port': ['ID=2890994f-299e-4a4d-8e0a-945b6c38ecfe,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:26.675786 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.306s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:26.685226 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1a6f5361-a879-4abe-8a52-d68dbc77b772 req-85d454bd-86ef-44f9-a0c9-b43cd4af099d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 210 time: 0.3455555
May 27 09:27:26.700436 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=43ed4068-0876-4362-b9a6-c0cfd260601e,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:26.706503 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d67d64-42f9-4b79-a6c8-2cc642196743 req-a304c519-fa99-4320-8689-facc15e099a0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:26.708607 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-22d67d64-42f9-4b79-a6c8-2cc642196743 req-a304c519-fa99-4320-8689-facc15e099a0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 931 time: 1.0782702
May 27 09:27:26.728581 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:26.797050 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:26.880058 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:26.929953 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-22d67d64-42f9-4b79-a6c8-2cc642196743 req-34a3d3e6-1f7e-468d-99b6-b407180ae1ec tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2068174
May 27 09:27:26.933049 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Attempting to bind port 2890994f-299e-4a4d-8e0a-945b6c38ecfe on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:26.934254 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Attempting to bind port 2890994f-299e-4a4d-8e0a-945b6c38ecfe by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:26.934771 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Attempting to bind port 2890994f-299e-4a4d-8e0a-945b6c38ecfe on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:26.941758 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Port 2890994f-299e-4a4d-8e0a-945b6c38ecfe on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:27:26.946402 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Attempting to bind port 2890994f-299e-4a4d-8e0a-945b6c38ecfe on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:26.965624 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:26.966301 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Checking segment: {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:26.967990 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Bound using segment: {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:26.969098 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Bound port: 2890994f-299e-4a4d-8e0a-945b6c38ecfe, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'}}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:26.969624 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:26.988277 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Network 624aa867-a71e-4343-8899-4e49257cd000 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:27.000741 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Pushing event updated for resources: {'Port': ['ID=7515b299-be21-49ae-9c90-975237275947,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:27.004251 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:27.022814 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:27.117741 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47294) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:27.191349 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:27:27.206028 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Sync routers for ids ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:27:27.220034 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:27.220648 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3816556'] for router_interface, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:27.240583 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Routers {'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:27.242143 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed99c700>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:27:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:27.255124 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Router ad64253e-1ce7-4c03-90db-1073e41e8e5f has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:27:27.276477 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] For port 2890994f-299e-4a4d-8e0a-945b6c38ecfe, host hv-cinder-77262, cleared binding levels {{(pid=91821) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:27:27.285177 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] For port 2890994f-299e-4a4d-8e0a-945b6c38ecfe, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=2890994f-299e-4a4d-8e0a-945b6c38ecfe,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91821) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:27:27.319809 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5d0c2da2-3b0c-41ea-ba17-fe6a7a767d88 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:27.348694 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:27.361525 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5d0c2da2-3b0c-41ea-ba17-fe6a7a767d88 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:27.366925 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5d0c2da2-3b0c-41ea-ba17-fe6a7a767d88 admin admin] Usage tracker for resource:security_group_rule and tenant:70afbbf5e72c464b8223cab4aca1e8d2 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:27.375697 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5d0c2da2-3b0c-41ea-ba17-fe6a7a767d88 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:27.399513 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5d0c2da2-3b0c-41ea-ba17-fe6a7a767d88 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:27.541316 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5d0c2da2-3b0c-41ea-ba17-fe6a7a767d88 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:27.547603 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5a5d8cf6-85e4-4001-b9dc-c34eadb2d10b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:27.565964 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 43ed4068-0876-4362-b9a6-c0cfd260601e up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:27.596003 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5d0c2da2-3b0c-41ea-ba17-fe6a7a767d88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:27.654259 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Allocated IP 172.20.0.14 (614fa2b9-1890-4e8d-9f9a-f79aaebf515d/fe9e7e1e-674a-4cd2-835e-ab14693282cf/da4faf50-f101-4d33-a820-86240054a093) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:27.672283 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-5d0c2da2-3b0c-41ea-ba17-fe6a7a767d88 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=70afbbf5e72c464b8223cab4aca1e8d2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5482385
May 27 09:27:27.685311 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47308) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:27.706201 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:27.719728 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:27.721929 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] 10.222.0.11 "PUT /v2.0/ports/2890994f-299e-4a4d-8e0a-945b6c38ecfe HTTP/1.1" status: 200  len: 1093 time: 3.9122834
May 27 09:27:27.759041 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] Notify callbacks [] for router, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:27.765332 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-c23a043b-776d-401f-9e53-c3422e509b05 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201  len: 930 time: 22.2205598
May 27 09:27:27.817224 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '771c169e-ea25-4862-a057-69f990bb8eab', 'tag': '2890994f-299e-4a4d-8e0a-945b6c38ecfe'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:27:27.829895 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-62e695da-e950-480c-9f97-ffa848d3e125 None None] Provisioning for port 7515b299-be21-49ae-9c90-975237275947 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:27.863190 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-62e695da-e950-480c-9f97-ffa848d3e125 None None] Provisioning complete for port 7515b299-be21-49ae-9c90-975237275947 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:27.867088 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-62e695da-e950-480c-9f97-ffa848d3e125 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:28.029048 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47314) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:28.164865 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-62e695da-e950-480c-9f97-ffa848d3e125 None None] Port 7515b299-be21-49ae-9c90-975237275947 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:27:28.172574 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Set router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:28.175997 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 43ed4068-0876-4362-b9a6-c0cfd260601e triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:28.177089 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:28.252715 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:27:28.274644 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] 10.222.0.30 "PUT /v2.0/routers/ad64253e-1ce7-4c03-90db-1073e41e8e5f/add_router_interface HTTP/1.1" status: 200  len: 503 time: 17.5353155
May 27 09:27:28.290551 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Sync routers for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:27:28.311649 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:28.312395 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd69340>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:27:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:28.802175 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:28.901605 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:28.988247 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ad1c90ab-8ff6-4cc3-abf4-a4f09abbdc09 req-cb0e8491-461e-435a-9623-098b539271f1 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 210 time: 0.5681295
May 27 09:27:29.019957 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Pushing event updated for resources: {'Port': ['ID=2890994f-299e-4a4d-8e0a-945b6c38ecfe,revision_number=3']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:29.048731 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.501s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:29.071011 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 1.415s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:29.137553 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0dcbd82e-e6df-4e4e-b115-fcfd4f48d13f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:29.154066 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed99c700>, [{'id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-router', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89'}], 'enable_snat': True}, 'gw_port_id': '8262e930-0850-4885-81df-37a7db4afa6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:14Z', 'revision_number': 3, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'gw_port': {'id': '8262e930-0850-4885-81df-37a7db4afa6d', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:22:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:10Z', 'updated_at': '2021-05-27T09:27:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:29.168840 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Checking router: fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:27:29.169196 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Updating router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 port 8262e930-0850-4885-81df-37a7db4afa6d binding host dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:27:29.283208 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:29.636805 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd69340>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:19Z', 'revision_number': 2, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:29.641898 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Checking router: ad64253e-1ce7-4c03-90db-1073e41e8e5f for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:27:29.642425 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Updating router ad64253e-1ce7-4c03-90db-1073e41e8e5f port b018c078-86c3-4e4a-bd90-fa725cdd3369 binding host dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:27:29.671705 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-494d53fd-0e9e-48c2-9571-ca03ea2d9177 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:29.671705 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-494d53fd-0e9e-48c2-9571-ca03ea2d9177 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 1096 time: 1.6405644
May 27 09:27:29.682872 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:29.704898 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 47346) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:29.766819 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d0c2da2-3b0c-41ea-ba17-fe6a7a767d88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dae0119a-e8bc-4a6e-a9c7-7dfe3d564db4,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:29.773760 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'security_group': {'name': 'tempest-securitygroup--814190656', 'description': 'tempest-description--438773210'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:29.784537 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5d0c2da2-3b0c-41ea-ba17-fe6a7a767d88 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.714s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:29.824266 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:29.870716 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:29.878863 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:29.887477 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.db.resource_extend [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] It took 0.15 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 27 09:27:29.925394 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:29.931042 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Usage tracker for resource:security_group and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:29.936917 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:29.996483 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Network 614fa2b9-1890-4e8d-9f9a-f79aaebf515d is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:30.006646 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:30.011328 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:30.015516 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:30.025954 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:30.027017 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:30.054092 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:30.073614 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 9.1065698
May 27 09:27:30.074120 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0dcbd82e-e6df-4e4e-b115-fcfd4f48d13f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:30.117708 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-54056a32-ec9b-4e02-acdc-4ce4f5634b04 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2890994f-299e-4a4d-8e0a-945b6c38ecfe HTTP/1.1" status: 200  len: 217 time: 0.4190648
May 27 09:27:30.123109 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:30.160808 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3683833', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3816655'] for router_interface, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:30.180605 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '771c169e-ea25-4862-a057-69f990bb8eab', 'tag': '2890994f-299e-4a4d-8e0a-945b6c38ecfe', 'status': 'completed', 'code': 200}
May 27 09:27:30.211552 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Request body: {'port': {'device_id': 'cf0e942c-e831-44eb-9aad-239ffadc6bbe', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:30.443144 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:30.457244 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Notify callbacks [] for port, precommit_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:30.495031 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.provisioning_blocks [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Transition to ACTIVE for port object 8262e930-0850-4885-81df-37a7db4afa6d will not be triggered until provisioned by entity L2. {{(pid=91823) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:30.514856 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:30.538892 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:30.578602 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-2cff9794-b640-4410-8e4e-6ca871751d15 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:30.581243 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-2cff9794-b640-4410-8e4e-6ca871751d15 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3d70d479-f390-4cd8-90ff-49a918615aa4 HTTP/1.1" status: 200  len: 855 time: 0.3904736
May 27 09:27:30.606989 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97faa25d-fca3-4a3b-a804-3007c168194f req-6d76cb40-9fb3-4470-8ce3-621a7927ecdb tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:30.622457 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-97faa25d-fca3-4a3b-a804-3007c168194f req-6d76cb40-9fb3-4470-8ce3-621a7927ecdb tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 943 time: 2.1704433
May 27 09:27:30.724308 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Pushing event updated for resources: {'Port': ['ID=da4faf50-f101-4d33-a820-86240054a093,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:30.760757 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.824s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:30.765947 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.386s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:30.825842 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:30.843261 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Attempting to bind port 8262e930-0850-4885-81df-37a7db4afa6d on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:30.864292 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Attempting to bind port 8262e930-0850-4885-81df-37a7db4afa6d by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:30.864951 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Attempting to bind port 8262e930-0850-4885-81df-37a7db4afa6d on network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:30.890870 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Usage tracker for resource:security_group_rule and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:30.914904 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:30.934929 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:30.935789 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Checking segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91823) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:30.936423 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:30.937058 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Bound using segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:30.937774 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Bound port: 8262e930-0850-4885-81df-37a7db4afa6d, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:30.943562 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:30.958299 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:30.983805 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Notify callbacks [] for port, precommit_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:31.003055 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Transition to ACTIVE for port object b018c078-86c3-4e4a-bd90-fa725cdd3369 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:31.018183 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:31.024880 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:31.039799 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c23c03-2253-444d-aaf5-70ebd7500901 None None] Pushing event updated for resources: {'Port': ['ID=8262e930-0850-4885-81df-37a7db4afa6d,revision_number=2']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:31.083019 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-83c23c03-2253-444d-aaf5-70ebd7500901 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.544s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:31.183340 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] For port 8262e930-0850-4885-81df-37a7db4afa6d, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91823) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:27:31.184921 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-4a7567cd-898d-4e3f-8643-72f207ae5902 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7cbf7538-2626-435d-83dd-e10fb0c9e965&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1012092
May 27 09:27:31.189614 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:31.193602 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] For port 8262e930-0850-4885-81df-37a7db4afa6d, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=8262e930-0850-4885-81df-37a7db4afa6d,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91823) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:27:31.203773 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:31.215430 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-22f42488-fc1e-4b05-90ec-324b55f3e0e4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:31.242247 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Pushing event updated for resources: {'Port': ['ID=7515b299-be21-49ae-9c90-975237275947,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:31.258867 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.490s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:31.495362 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99208fb7-1e65-4d80-b32a-63b86fb084e8 None None] Pushing event updated for resources: {'Port': ['ID=b018c078-86c3-4e4a-bd90-fa725cdd3369,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:31.507327 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-99208fb7-1e65-4d80-b32a-63b86fb084e8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.482s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:31.541266 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Network 624aa867-a71e-4343-8899-4e49257cd000 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:31.577220 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:31.579484 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Routers {'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:31.580149 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed99c700>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:27:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:31.728992 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0dcbd82e-e6df-4e4e-b115-fcfd4f48d13f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:31.774014 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:31.812983 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:31.977792 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Attempting to bind port b018c078-86c3-4e4a-bd90-fa725cdd3369 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:31.978357 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Attempting to bind port b018c078-86c3-4e4a-bd90-fa725cdd3369 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:31.978862 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Attempting to bind port b018c078-86c3-4e4a-bd90-fa725cdd3369 on network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:31.992223 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-b6d615ec-9d1b-48b6-a344-c2e50141004a service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3780751
May 27 09:27:32.020820 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-819b7679-1365-439d-b55b-893122ccaeac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:32.046860 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:32.047601 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Checking segment: {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:32.049109 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:32.049532 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Bound using segment: {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:32.050063 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Bound port: b018c078-86c3-4e4a-bd90-fa725cdd3369, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:32.050633 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:32.068113 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-97faa25d-fca3-4a3b-a804-3007c168194f req-286a793f-21e6-47a0-bf64-d3cbbdc96839 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 1.4093294
May 27 09:27:32.075162 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dcbd82e-e6df-4e4e-b115-fcfd4f48d13f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dae0119a-e8bc-4a6e-a9c7-7dfe3d564db4,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:32.120982 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] Set router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:32.134918 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0dcbd82e-e6df-4e4e-b115-fcfd4f48d13f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:32.183771 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0dcbd82e-e6df-4e4e-b115-fcfd4f48d13f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:32.190894 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-0dcbd82e-e6df-4e4e-b115-fcfd4f48d13f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/dae0119a-e8bc-4a6e-a9c7-7dfe3d564db4 HTTP/1.1" status: 204  len: 168 time: 4.5005496
May 27 09:27:32.403107 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c23c03-2253-444d-aaf5-70ebd7500901 None None] Pushing event updated for resources: {'Port': ['ID=8262e930-0850-4885-81df-37a7db4afa6d,revision_number=3']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:32.420763 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-83c23c03-2253-444d-aaf5-70ebd7500901 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.207s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:32.483001 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9533a33f-6e71-416b-8947-a997156d2b4e req-f409f000-3491-4185-bed5-07a0b237f692 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:32.505618 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9533a33f-6e71-416b-8947-a997156d2b4e req-f409f000-3491-4185-bed5-07a0b237f692 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 932 time: 2.0054722
May 27 09:27:32.546215 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-ea10621d-1b2a-4961-bf30-862bd516007c None None] Provisioning complete for port 7515b299-be21-49ae-9c90-975237275947 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:32.549580 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ea10621d-1b2a-4961-bf30-862bd516007c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:32.598021 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:32.707594 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-9533a33f-6e71-416b-8947-a997156d2b4e req-2244f5ce-f3ee-4e1c-a202-046250b9f408 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Synchronizing usage tracker for tenant:1e809ec6b9624e98a228033a8d2c59f1 on resource:security_group {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:32.836393 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 47388) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:32.900587 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-ea10621d-1b2a-4961-bf30-862bd516007c None None] Port 7515b299-be21-49ae-9c90-975237275947 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:27:32.952686 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] For port b018c078-86c3-4e4a-bd90-fa725cdd3369, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:27:32.971540 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] For port b018c078-86c3-4e4a-bd90-fa725cdd3369, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=b018c078-86c3-4e4a-bd90-fa725cdd3369,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:27:32.982535 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:32.987313 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-adfaba07-d126-4643-ba33-7aead246af3c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:33.013988 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed99c700>, [{'id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-router', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89'}], 'enable_snat': True}, 'gw_port_id': '8262e930-0850-4885-81df-37a7db4afa6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:14Z', 'revision_number': 3, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'gw_port': {'id': '8262e930-0850-4885-81df-37a7db4afa6d', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:22:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:10Z', 'updated_at': '2021-05-27T09:27:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:33.027400 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e0e8a26d-c723-400d-b02b-a100150018f8 None None] The sync data for ids ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'] in dv-cinder-772623-6-iscsi is: [{'id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-router', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89'}], 'enable_snat': True}, 'gw_port_id': '8262e930-0850-4885-81df-37a7db4afa6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:14Z', 'revision_number': 3, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'gw_port': {'id': '8262e930-0850-4885-81df-37a7db4afa6d', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:22:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:10Z', 'updated_at': '2021-05-27T09:27:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:27:33.066837 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:33.077095 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-9533a33f-6e71-416b-8947-a997156d2b4e req-2244f5ce-f3ee-4e1c-a202-046250b9f408 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Unset dirty status for tenant:1e809ec6b9624e98a228033a8d2c59f1 on resource:security_group {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:33.080678 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9533a33f-6e71-416b-8947-a997156d2b4e req-2244f5ce-f3ee-4e1c-a202-046250b9f408 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5726981
May 27 09:27:33.103560 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:27:33.210103 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4eba5435-2d96-4034-9b7f-ce7869d6dbf5 req-d9d11329-fefe-4a0d-95dc-eb1fff88fb5a service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 1.1394377
May 27 09:27:33.227005 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:33.234129 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd69340>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:27:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:33.247928 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:33.266313 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 3.5555491
May 27 09:27:33.268088 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 47404) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:33.276364 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.671s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:33.406534 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'security_group_rule': {'security_group_id': 'a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:33.444921 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:33.474520 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Usage tracker for resource:security_group_rule and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:33.487511 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:33.520178 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:33.675000 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:33.726292 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99208fb7-1e65-4d80-b32a-63b86fb084e8 None None] Pushing event updated for resources: {'Port': ['ID=b018c078-86c3-4e4a-bd90-fa725cdd3369,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:33.840001 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-99208fb7-1e65-4d80-b32a-63b86fb084e8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.852s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:33.849351 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:27:33.877568 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:34.051401 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:34.409215 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f794dba0-17b0-4e99-9837-aff0e81ce514 req-e631f4ee-09fe-437f-b1ec-da6f3f0114b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:34.417235 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f794dba0-17b0-4e99-9837-aff0e81ce514 req-e631f4ee-09fe-437f-b1ec-da6f3f0114b8 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 1096 time: 0.9893358
May 27 09:27:34.441173 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e368c34b-f678-43ae-972e-e310a05e9099 req-ef5af305-5844-4c2a-bdb1-827cb35a89f1 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:34.452883 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e368c34b-f678-43ae-972e-e310a05e9099 req-ef5af305-5844-4c2a-bdb1-827cb35a89f1 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 943 time: 0.5286007
May 27 09:27:34.796146 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd69340>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:32Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:34.806094 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-68af37bc-c53d-417b-a493-7eec10a3c920 None None] The sync data for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi is: [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:32Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:27:34.982828 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e368c34b-f678-43ae-972e-e310a05e9099 req-fd127b4f-dd97-4d21-a8ab-c9ba339dfc2d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5276513
May 27 09:27:35.090432 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-69a4cc2f-5bda-4024-ae8b-c37373ee3236 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:35.141355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-69a4cc2f-5bda-4024-ae8b-c37373ee3236 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:35.150514 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-69a4cc2f-5bda-4024-ae8b-c37373ee3236 admin admin] Usage tracker for resource:security_group_rule and tenant:c4fe516745d5449785aa33fa0ad780e0 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:35.168950 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-69a4cc2f-5bda-4024-ae8b-c37373ee3236 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:35.212405 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-69a4cc2f-5bda-4024-ae8b-c37373ee3236 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:35.234254 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f794dba0-17b0-4e99-9837-aff0e81ce514 req-dcc91370-655e-40ec-9fd5-f9ab966ab4fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:35.236077 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f794dba0-17b0-4e99-9837-aff0e81ce514 req-dcc91370-655e-40ec-9fd5-f9ab966ab4fd service neutron] 10.222.0.11 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 916 time: 0.6882260
May 27 09:27:35.378228 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Allocated IP 172.20.0.1 (ca288a2a-9fc5-474b-a3f5-732ddd5ede80/2171d20e-0746-4ea0-9aa2-e8adfb7e51ac/d9d28434-09e7-48ed-9844-ef965b2d090b) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:35.382461 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f794dba0-17b0-4e99-9837-aff0e81ce514 req-09e51a21-e939-4425-aece-0cebad5b1a48 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2890994f-299e-4a4d-8e0a-945b6c38ecfe HTTP/1.1" status: 200  len: 217 time: 0.1289935
May 27 09:27:35.410066 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94888198-8c16-490b-ba41-8d4f060b9c28 req-01085875-97e9-4969-813c-7b3dc90bfbe3 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:35.418296 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-94888198-8c16-490b-ba41-8d4f060b9c28 req-01085875-97e9-4969-813c-7b3dc90bfbe3 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 932 time: 0.5725832
May 27 09:27:35.793023 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-69a4cc2f-5bda-4024-ae8b-c37373ee3236 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:35.847928 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 8262e930-0850-4885-81df-37a7db4afa6d up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:35.856883 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-94888198-8c16-490b-ba41-8d4f060b9c28 req-099f1305-90be-4410-a482-69e195ed5ee9 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4374912
May 27 09:27:35.880334 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f794dba0-17b0-4e99-9837-aff0e81ce514 req-06a3aa9a-f1f7-4903-90fa-f08b5b9e4eb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:35.883765 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f794dba0-17b0-4e99-9837-aff0e81ce514 req-06a3aa9a-f1f7-4903-90fa-f08b5b9e4eb0 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3d70d479-f390-4cd8-90ff-49a918615aa4 HTTP/1.1" status: 200  len: 855 time: 0.4470921
May 27 09:27:35.959107 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-69a4cc2f-5bda-4024-ae8b-c37373ee3236 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:36.023065 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:36.061821 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f794dba0-17b0-4e99-9837-aff0e81ce514 req-cd894bce-09a4-4feb-9913-b660598d9ce3 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7cbf7538-2626-435d-83dd-e10fb0c9e965&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1662064
May 27 09:27:36.072060 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 8262e930-0850-4885-81df-37a7db4afa6d completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:36.089595 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 8262e930-0850-4885-81df-37a7db4afa6d triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:36.091206 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:36.573609 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:27:36.589115 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69a4cc2f-5bda-4024-ae8b-c37373ee3236 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5844f90c-2e39-4332-bcd4-61c68eb49c01,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:36.591786 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Sync routers for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:27:36.624348 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:36.625178 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed05aac0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:27:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:36.655982 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-69a4cc2f-5bda-4024-ae8b-c37373ee3236 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.633s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:36.664970 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:36.745257 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 8262e930-0850-4885-81df-37a7db4afa6d, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=8262e930-0850-4885-81df-37a7db4afa6d,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:36.758745 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:36.759864 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device b018c078-86c3-4e4a-bd90-fa725cdd3369 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:36.762917 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:36.776184 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-69a4cc2f-5bda-4024-ae8b-c37373ee3236 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c4fe516745d5449785aa33fa0ad780e0&name=default HTTP/1.1" status: 200  len: 2979 time: 3.7437744
May 27 09:27:36.788537 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] 10.222.0.30 "PUT /v2.0/routers/a7747f73-c1a4-4a6c-8c93-cf80d93a5583/add_router_interface HTTP/1.1" status: 200  len: 503 time: 21.5619118
May 27 09:27:36.792219 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 47442) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:36.976458 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:37.124459 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:37.276658 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:37.293162 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port b018c078-86c3-4e4a-bd90-fa725cdd3369 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:37.351431 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:37.361043 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=8262e930-0850-4885-81df-37a7db4afa6d,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:37.385245 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.409s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:37.392550 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port b018c078-86c3-4e4a-bd90-fa725cdd3369 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:37.393933 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:37.488762 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id da4faf50-f101-4d33-a820-86240054a093 {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:27:37.497075 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1e6d2cd7-b981-4e8f-91c7-5a0c640ea8e7,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:37.565449 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:37.572060 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.304s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:37.592637 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:37.598446 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 4.2710121
May 27 09:27:37.599043 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:37.604580 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 47456) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:37.644882 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'security_group_rule': {'security_group_id': 'a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:37.695151 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:37.705542 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:37.739533 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Transition to ACTIVE for port object da4faf50-f101-4d33-a820-86240054a093 will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:37.769495 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port b018c078-86c3-4e4a-bd90-fa725cdd3369, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=b018c078-86c3-4e4a-bd90-fa725cdd3369,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:37.778006 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:37.781649 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:37.810572 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Usage tracker for resource:security_group_rule and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:37.817608 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:37.826098 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:37.850707 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:37.916141 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=b018c078-86c3-4e4a-bd90-fa725cdd3369,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:37.920709 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:37.925026 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bbf6f3ef-73d8-4c72-b99e-b15e9244c4d1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:37.982156 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:38.087811 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 8262e930-0850-4885-81df-37a7db4afa6d up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:38.108836 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bbf6f3ef-73d8-4c72-b99e-b15e9244c4d1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:38.133966 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f794dba0-17b0-4e99-9837-aff0e81ce514 req-25e5be75-d671-4e44-a18c-d75b1261e0c1 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 1.9926376
May 27 09:27:38.290270 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 8262e930-0850-4885-81df-37a7db4afa6d triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:38.290732 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:38.522333 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed05aac0>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:29Z', 'revision_number': 2, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:38.539704 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-0e50ba29-0b3d-40fe-baa2-e4841ea95632 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:38.547890 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Checking router: a7747f73-c1a4-4a6c-8c93-cf80d93a5583 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:27:38.549376 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Updating router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 port 7515b299-be21-49ae-9c90-975237275947 binding host dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:27:38.613936 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:38.617719 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5442842-6070-48d0-9e8b-c14220cda760 req-f68aade8-3376-481f-bd0b-760178dc7e8c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:38.632596 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f5442842-6070-48d0-9e8b-c14220cda760 req-f68aade8-3376-481f-bd0b-760178dc7e8c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 943 time: 1.6786194
May 27 09:27:38.643798 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Pushing event updated for resources: {'Port': ['ID=da4faf50-f101-4d33-a820-86240054a093,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:38.682949 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.832s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:38.695694 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bbf6f3ef-73d8-4c72-b99e-b15e9244c4d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:38.699267 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:38.714229 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e239d7f2-9489-40cc-8d39-be2f60aead52 req-ad88286d-c657-47bf-a0e4-13658028566f tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:38.717304 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e239d7f2-9489-40cc-8d39-be2f60aead52 req-ad88286d-c657-47bf-a0e4-13658028566f tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 932 time: 1.2756267
May 27 09:27:38.734758 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:38.739623 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:38.758821 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Attempting to bind port da4faf50-f101-4d33-a820-86240054a093 on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:38.759545 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Attempting to bind port da4faf50-f101-4d33-a820-86240054a093 by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '519332c4-0201-4d92-9424-ec0b1d1407e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '614fa2b9-1890-4e8d-9f9a-f79aaebf515d'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:38.760178 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Attempting to bind port da4faf50-f101-4d33-a820-86240054a093 on network 614fa2b9-1890-4e8d-9f9a-f79aaebf515d {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:38.784916 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:38.799510 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Port da4faf50-f101-4d33-a820-86240054a093 on network 614fa2b9-1890-4e8d-9f9a-f79aaebf515d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:27:38.800283 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Attempting to bind port da4faf50-f101-4d33-a820-86240054a093 on network 614fa2b9-1890-4e8d-9f9a-f79aaebf515d {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:38.823388 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:38.824135 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Checking segment: {'id': '519332c4-0201-4d92-9424-ec0b1d1407e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '614fa2b9-1890-4e8d-9f9a-f79aaebf515d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:38.825128 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Bound using segment: {'id': '519332c4-0201-4d92-9424-ec0b1d1407e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '614fa2b9-1890-4e8d-9f9a-f79aaebf515d'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:38.826016 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Bound port: da4faf50-f101-4d33-a820-86240054a093, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '519332c4-0201-4d92-9424-ec0b1d1407e4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 387, 'network_id': '614fa2b9-1890-4e8d-9f9a-f79aaebf515d'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:38.826670 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:38.913779 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbf6f3ef-73d8-4c72-b99e-b15e9244c4d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5844f90c-2e39-4332-bcd4-61c68eb49c01,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:38.921488 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-bbf6f3ef-73d8-4c72-b99e-b15e9244c4d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:38.987685 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f5442842-6070-48d0-9e8b-c14220cda760 req-faaa7760-c68b-4b44-a94a-4b8691a574cf tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3408215
May 27 09:27:38.997734 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:39.020704 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:39.047102 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:39.047984 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3816556'] for router_interface, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:39.086996 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bbf6f3ef-73d8-4c72-b99e-b15e9244c4d1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:39.088909 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-bbf6f3ef-73d8-4c72-b99e-b15e9244c4d1 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5844f90c-2e39-4332-bcd4-61c68eb49c01 HTTP/1.1" status: 204  len: 168 time: 1.9667461
May 27 09:27:39.165881 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:39.207229 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:39.222898 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-73c158a6-2801-44c7-ada0-e5ed1a44535e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:39.307764 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] For port da4faf50-f101-4d33-a820-86240054a093, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:27:39.315001 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f09f7436-0259-4fe7-aec9-ab5e1bb032db,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:39.344288 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:39.366162 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] For port da4faf50-f101-4d33-a820-86240054a093, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=da4faf50-f101-4d33-a820-86240054a093,segment=NetworkSegment(519332c4-0201-4d92-9424-ec0b1d1407e4),segment_id=519332c4-0201-4d92-9424-ec0b1d1407e4)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:27:39.370650 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:39.381953 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 1.7534225
May 27 09:27:39.382290 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 47480) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:39.388795 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:39.396527 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'floatingip': {'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:39.420938 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:39.427431 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2620b3b0-4920-4b65-9a6b-a0e157b812ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:39.448839 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Pushing event updated for resources: {'Port': ['ID=d9d28434-09e7-48ed-9844-ef965b2d090b,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:39.494863 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.755s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:39.507683 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f794dba0-17b0-4e99-9837-aff0e81ce514 req-d56d6d4f-a647-4946-b31c-608af66b1529 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 1.3154442
May 27 09:27:39.538804 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e239d7f2-9489-40cc-8d39-be2f60aead52 req-7d9fc5c5-de63-4685-a1ed-c43064de1e99 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6911948
May 27 09:27:39.575605 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Usage tracker for resource:floatingip and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:39.589026 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:39.663269 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:39.714625 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:39.728775 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:39.735561 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] 10.222.0.11 "PUT /v2.0/ports/da4faf50-f101-4d33-a820-86240054a093 HTTP/1.1" status: 200  len: 1094 time: 9.5423977
May 27 09:27:39.744581 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'cf0e942c-e831-44eb-9aad-239ffadc6bbe', 'tag': 'da4faf50-f101-4d33-a820-86240054a093'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:27:39.910090 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Notify callbacks [] for port, precommit_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:40.002937 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device b018c078-86c3-4e4a-bd90-fa725cdd3369 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:40.026619 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.provisioning_blocks [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Transition to ACTIVE for port object 7515b299-be21-49ae-9c90-975237275947 will not be triggered until provisioned by entity L2. {{(pid=91823) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:40.056087 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:40.122485 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-0fcc228e-2551-4af5-8de2-b8a5f74b3fe1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:40.204041 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:40.263282 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:40.358216 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port b018c078-86c3-4e4a-bd90-fa725cdd3369 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:40.360246 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:40.484031 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Pushing event updated for resources: {'Port': ['ID=da4faf50-f101-4d33-a820-86240054a093,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:40.514907 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.087s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:40.662364 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-873818d7-c976-4f0d-9786-94059ebcc2c7 None None] Pushing event updated for resources: {'Port': ['ID=7515b299-be21-49ae-9c90-975237275947,revision_number=3']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:40.716324 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-873818d7-c976-4f0d-9786-94059ebcc2c7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.594s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:40.957482 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 2890994f-299e-4a4d-8e0a-945b6c38ecfe details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:27:41.072183 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:41.112878 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:41.128450 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3683833', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3816655'] for router_interface, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:41.153325 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:41.230290 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47500) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:41.231026 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Attempting to bind port 7515b299-be21-49ae-9c90-975237275947 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:41.231467 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Attempting to bind port 7515b299-be21-49ae-9c90-975237275947 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:41.231467 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Attempting to bind port 7515b299-be21-49ae-9c90-975237275947 on network 624aa867-a71e-4343-8899-4e49257cd000 {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:41.260338 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 12), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:41.261229 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Checking segment: {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91823) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:41.261896 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:41.264074 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Bound using segment: {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:41.270720 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Bound port: 7515b299-be21-49ae-9c90-975237275947, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'}}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:41.274947 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:41.299240 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.db.resource_extend [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] It took 0.26 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 27 09:27:41.410260 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-2b71b921-ddaa-433e-9c0d-5f17ac0b0bb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:41.413584 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-2b71b921-ddaa-433e-9c0d-5f17ac0b0bb6 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1e809ec6b9624e98a228033a8d2c59f1&device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 1097 time: 1.3740377
May 27 09:27:41.520002 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47506) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:41.572463 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] For port 7515b299-be21-49ae-9c90-975237275947, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91823) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:27:41.586391 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] For port 7515b299-be21-49ae-9c90-975237275947, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=7515b299-be21-49ae-9c90-975237275947,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91823) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:27:41.598424 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:41.608944 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-750ff5e8-208b-4298-b77c-177a1d01b4fd service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=da4faf50-f101-4d33-a820-86240054a093 HTTP/1.1" status: 200  len: 217 time: 0.1818602
May 27 09:27:41.614683 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:41.635748 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1319276584', 'description': 'tempest-description--293617703'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:41.708138 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-696a129c-16b3-4f0d-a69f-a98cb3493b07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:41.710643 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-696a129c-16b3-4f0d-a69f-a98cb3493b07 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=fe9e7e1e-674a-4cd2-835e-ab14693282cf HTTP/1.1" status: 200  len: 852 time: 0.0824964
May 27 09:27:41.718366 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:41.727178 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:41.729369 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5040358b-e50b-490d-8298-d34e1fff1ec0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:41.748546 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:41.813725 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-9a34db1b-df9e-4d8b-8141-181600e91f0c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=614fa2b9-1890-4e8d-9f9a-f79aaebf515d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0883191
May 27 09:27:41.819410 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:41.880563 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 2890994f-299e-4a4d-8e0a-945b6c38ecfe, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=2890994f-299e-4a4d-8e0a-945b6c38ecfe,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:41.907754 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-afdc4127-322b-40f3-b9e5-5abb8a5a5bb4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:41.935069 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '2890994f-299e-4a4d-8e0a-945b6c38ecfe', 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965', 'port_id': '2890994f-299e-4a4d-8e0a-945b6c38ecfe', 'mac_address': 'fa:16:3e:4e:5b:0e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 386, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3d70d479-f390-4cd8-90ff-49a918615aa4', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:27:41.967801 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:41.968944 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed05aac0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:27:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:41.992417 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:42.055272 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:42.093273 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2890994f-299e-4a4d-8e0a-945b6c38ecfe {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:27:42.128061 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 2890994f-299e-4a4d-8e0a-945b6c38ecfe, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=2890994f-299e-4a4d-8e0a-945b6c38ecfe,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:42.141691 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:42.151873 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:42.193055 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-873818d7-c976-4f0d-9786-94059ebcc2c7 None None] Pushing event updated for resources: {'Port': ['ID=7515b299-be21-49ae-9c90-975237275947,revision_number=4']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:42.204301 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-873818d7-c976-4f0d-9786-94059ebcc2c7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.589s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:42.268114 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5040358b-e50b-490d-8298-d34e1fff1ec0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:42.274257 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Usage tracker for resource:security_group and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:42.317263 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-d457a384-95b7-4afe-aba3-5b22b030e301 service neutron] 10.222.0.11 "GET /v2.0/networks/614fa2b9-1890-4e8d-9f9a-f79aaebf515d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4964378
May 27 09:27:42.331104 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:42.388172 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5040358b-e50b-490d-8298-d34e1fff1ec0 admin admin] Usage tracker for resource:security_group_rule and tenant:93b7e11c8e6d4f73badef576f7c87a8d is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:42.423504 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Pushing event updated for resources: {'Port': ['ID=d9d28434-09e7-48ed-9844-ef965b2d090b,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:42.441129 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=2890994f-299e-4a4d-8e0a-945b6c38ecfe,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:42.446386 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5040358b-e50b-490d-8298-d34e1fff1ec0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:42.450581 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['2890994f-299e-4a4d-8e0a-945b6c38ecfe'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:27:42.452344 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:42.471940 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.302s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:42.519999 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:42.539763 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5040358b-e50b-490d-8298-d34e1fff1ec0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:42.577396 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.425s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:42.600883 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:42.654278 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Allocated IP 172.27.1.118 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/76c69881-aefd-4a3c-bc28-adbfe8bab0a8) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:42.807578 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cfff44a-3c1e-4e9f-a6ee-3b1e6691f4f2 req-f451c181-c1ba-45f4-a8f6-c8fcf9665487 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:42.810251 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0cfff44a-3c1e-4e9f-a6ee-3b1e6691f4f2 req-f451c181-c1ba-45f4-a8f6-c8fcf9665487 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 943 time: 1.8981044
May 27 09:27:42.866006 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:43.024382 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:43.043166 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Usage tracker for resource:security_group_rule and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:43.065044 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:43.162220 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0cfff44a-3c1e-4e9f-a6ee-3b1e6691f4f2 req-fd684715-d4f8-4279-813c-c90755f40748 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3339434
May 27 09:27:43.172973 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:43.191573 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6675df21-b436-4898-ab28-1357e1acd3f5 req-314a78cf-3ee2-4f37-ae6e-6a3f57eabb92 service neutron] 10.222.0.11 "GET /v2.0/networks/614fa2b9-1890-4e8d-9f9a-f79aaebf515d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8520451
May 27 09:27:43.231232 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:43.239941 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:27:43.308720 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:43.331726 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:43.429411 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc5c1611-436a-45b0-87ef-d49bc25fb5a2 req-bf7d8283-f169-48a6-80a0-76877e0907ce tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:43.442423 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cc5c1611-436a-45b0-87ef-d49bc25fb5a2 req-bf7d8283-f169-48a6-80a0-76877e0907ce tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 944 time: 1.7222068
May 27 09:27:43.575675 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'cf0e942c-e831-44eb-9aad-239ffadc6bbe', 'tag': 'da4faf50-f101-4d33-a820-86240054a093', 'status': 'completed', 'code': 200}
May 27 09:27:43.606399 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed05aac0>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:41Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:43.614456 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-75a2df4b-71aa-46da-ab07-835a5c8b9813 None None] The sync data for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi is: [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:41Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:27:43.722551 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:43.732666 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:43.765072 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:43.770562 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'Port': ['ID=76c69881-aefd-4a3c-bc28-adbfe8bab0a8,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:43.788481 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.457s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:43.980299 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3013d335-28f7-4a52-9d33-dc792e47e305 req-b91c8e3d-71f9-4cff-bf4b-2744c5b70fc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:43.983071 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3013d335-28f7-4a52-9d33-dc792e47e305 req-b91c8e3d-71f9-4cff-bf4b-2744c5b70fc4 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=1e809ec6b9624e98a228033a8d2c59f1&device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 1097 time: 0.4019325
May 27 09:27:43.985019 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:44.054135 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cc5c1611-436a-45b0-87ef-d49bc25fb5a2 req-f09875b6-e6ff-44a5-b591-184df512d18b tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.6104662
May 27 09:27:44.061426 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5040358b-e50b-490d-8298-d34e1fff1ec0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:44.074332 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 7515b299-be21-49ae-9c90-975237275947 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:44.218667 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3013d335-28f7-4a52-9d33-dc792e47e305 req-8a0096fc-8520-4e64-a1b6-4dd816848fa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:44.220597 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3013d335-28f7-4a52-9d33-dc792e47e305 req-8a0096fc-8520-4e64-a1b6-4dd816848fa0 service neutron] 10.222.0.11 "GET /v2.0/networks?id=614fa2b9-1890-4e8d-9f9a-f79aaebf515d HTTP/1.1" status: 200  len: 913 time: 0.2255323
May 27 09:27:44.316330 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5040358b-e50b-490d-8298-d34e1fff1ec0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:44.367225 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 7515b299-be21-49ae-9c90-975237275947 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:44.389748 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 7515b299-be21-49ae-9c90-975237275947 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:44.390684 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:44.402762 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:44.499954 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:27:44.504426 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:44.509342 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5040358b-e50b-490d-8298-d34e1fff1ec0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a95e58a3-4466-4e7e-aaf5-a19f53386b52,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:44.557262 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:44.559880 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-5040358b-e50b-490d-8298-d34e1fff1ec0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=93b7e11c8e6d4f73badef576f7c87a8d&name=default HTTP/1.1" status: 200  len: 2979 time: 3.3221564
May 27 09:27:44.561088 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5040358b-e50b-490d-8298-d34e1fff1ec0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:44.576493 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47542) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:44.609263 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Sync routers for ids ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:27:44.620251 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ba047552-e265-445b-96f9-0018b1d7bc66 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:44.651983 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Routers {'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:44.653034 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecaa6640>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:27:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:44.741801 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:44.773422 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3013d335-28f7-4a52-9d33-dc792e47e305 req-9bef5ba9-3127-4de3-b22a-03893c8669e3 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=da4faf50-f101-4d33-a820-86240054a093 HTTP/1.1" status: 200  len: 217 time: 0.5351577
May 27 09:27:44.805784 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'SecurityGroup': ['ID=dea06109-ed5b-4c12-9420-16f8bc9a235a,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:44.847855 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:44.910517 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3013d335-28f7-4a52-9d33-dc792e47e305 req-496e80fc-58e2-4ef7-b270-b087ed64e672 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:44.914608 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3013d335-28f7-4a52-9d33-dc792e47e305 req-496e80fc-58e2-4ef7-b270-b087ed64e672 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=fe9e7e1e-674a-4cd2-835e-ab14693282cf HTTP/1.1" status: 200  len: 852 time: 0.1195939
May 27 09:27:44.915555 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] 10.222.0.30 "PUT /v2.0/routers/fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0/add_router_interface HTTP/1.1" status: 200  len: 503 time: 16.8699076
May 27 09:27:44.971866 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:44.987774 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1779 time: 3.4136791
May 27 09:27:44.990720 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47550) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:45.047291 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'security_group_rule': {'security_group_id': 'dea06109-ed5b-4c12-9420-16f8bc9a235a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:45.058624 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:45.069758 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 2890994f-299e-4a4d-8e0a-945b6c38ecfe up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:45.072325 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Usage tracker for resource:security_group_rule and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:45.073920 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3013d335-28f7-4a52-9d33-dc792e47e305 req-e6614ed4-a245-4555-beab-67b494d94c81 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=614fa2b9-1890-4e8d-9f9a-f79aaebf515d&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1089256
May 27 09:27:45.079848 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:45.093796 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:45.154518 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f7bbeea2-55a5-43ef-a838-a945f6ed52a0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:45.172335 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:45.234927 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28481506-f562-4cbd-922c-c810ac93d5e8 req-a61aee63-3566-42f9-9fa3-04bdb0c20aae tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:45.236626 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-28481506-f562-4cbd-922c-c810ac93d5e8 req-a61aee63-3566-42f9-9fa3-04bdb0c20aae tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 944 time: 0.7245543
May 27 09:27:45.314729 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f7bbeea2-55a5-43ef-a838-a945f6ed52a0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:45.400719 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:45.474544 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:45.633894 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-28481506-f562-4cbd-922c-c810ac93d5e8 req-319cc9b9-cb55-4b56-8aa0-5a9608c4d3c0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3858654
May 27 09:27:45.697567 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 7515b299-be21-49ae-9c90-975237275947, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=7515b299-be21-49ae-9c90-975237275947,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:45.734816 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:45.740940 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-99208fb7-1e65-4d80-b32a-63b86fb084e8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:45.749133 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f7bbeea2-55a5-43ef-a838-a945f6ed52a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:45.789978 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:45.819150 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7bbeea2-55a5-43ef-a838-a945f6ed52a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a95e58a3-4466-4e7e-aaf5-a19f53386b52,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:45.821759 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-f7bbeea2-55a5-43ef-a838-a945f6ed52a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:45.899357 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=7515b299-be21-49ae-9c90-975237275947,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:45.908191 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:45.933876 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Set router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:45.937672 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:45.939233 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3013d335-28f7-4a52-9d33-dc792e47e305 req-d95a8d15-90de-43ea-84f3-5b8504be4959 service neutron] 10.222.0.11 "GET /v2.0/networks/614fa2b9-1890-4e8d-9f9a-f79aaebf515d?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.8566964
May 27 09:27:45.945259 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:45.949672 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:45.954867 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f7bbeea2-55a5-43ef-a838-a945f6ed52a0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:45.960740 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-f7bbeea2-55a5-43ef-a838-a945f6ed52a0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a95e58a3-4466-4e7e-aaf5-a19f53386b52 HTTP/1.1" status: 204  len: 168 time: 1.3715913
May 27 09:27:45.988203 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:46.056962 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2afc7a5-e0a2-4db3-ad32-c60191370447 req-8eee9567-cc2e-43be-9135-971b6ca2fd98 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:46.076156 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d2afc7a5-e0a2-4db3-ad32-c60191370447 req-8eee9567-cc2e-43be-9135-971b6ca2fd98 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 944 time: 0.6730745
May 27 09:27:46.148172 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:46.194450 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 2890994f-299e-4a4d-8e0a-945b6c38ecfe completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:46.202528 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:46.239293 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8dd7aa3a-6e49-4d33-b71b-c3b34972ae8e,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:46.301477 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.313s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:46.308543 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:46.316675 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 1.3215587
May 27 09:27:46.320402 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47580) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:46.340441 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'security_group_rule': {'security_group_id': 'dea06109-ed5b-4c12-9420-16f8bc9a235a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:46.340929 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 2890994f-299e-4a4d-8e0a-945b6c38ecfe triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:46.341715 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:46.432790 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:46.469263 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'Port': ['ID=76c69881-aefd-4a3c-bc28-adbfe8bab0a8,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:46.481381 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.279s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:46.489937 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:46.508212 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 7.1236506
May 27 09:27:46.563706 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:46.593221 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Usage tracker for resource:security_group_rule and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:46.602315 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:46.609426 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3013d335-28f7-4a52-9d33-dc792e47e305 req-407d1aca-516a-42a2-a744-edda3366e451 service neutron] 10.222.0.11 "GET /v2.0/networks/614fa2b9-1890-4e8d-9f9a-f79aaebf515d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6521246
May 27 09:27:46.632065 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d2afc7a5-e0a2-4db3-ad32-c60191370447 req-7d1505f3-debd-4f81-adb4-4288883a2b15 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5535183
May 27 09:27:46.638612 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:46.845563 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40329ab5-7093-4afa-92be-87374c079c70 req-9fe908eb-35ca-4782-89b2-56046c01dd55 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:46.847199 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-40329ab5-7093-4afa-92be-87374c079c70 req-9fe908eb-35ca-4782-89b2-56046c01dd55 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Synchronizing usage tracker for tenant:e165c54223b24166b6856b6f285c4bca on resource:network {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:46.870327 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:46.873186 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:46.916203 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-40329ab5-7093-4afa-92be-87374c079c70 req-9fe908eb-35ca-4782-89b2-56046c01dd55 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Unset dirty status for tenant:e165c54223b24166b6856b6f285c4bca on resource:network {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:46.918504 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-9fe908eb-35ca-4782-89b2-56046c01dd55 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 819 time: 0.7347360
May 27 09:27:46.961624 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device da4faf50-f101-4d33-a820-86240054a093 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:27:46.971081 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-c0894d66-4064-4a34-af13-0b8884d34233 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/quotas/e165c54223b24166b6856b6f285c4bca HTTP/1.1" status: 200  len: 375 time: 0.0217071
May 27 09:27:47.111521 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:47.149291 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:47.166752 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '771c169e-ea25-4862-a057-69f990bb8eab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2890994f-299e-4a4d-8e0a-945b6c38ecfe'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:27:47.199499 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-86c966b4-acc1-4436-9cc2-a69a2fe7916c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:47.257001 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b925dbb1-893b-46c1-8d74-757116bbd2da,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:47.269878 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:47.278402 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:47.279913 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-0dda86b8-1314-4b4a-acc2-c2c28b196055 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.9496226
May 27 09:27:47.284624 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 47604) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:47.290131 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'floatingip': {'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:47.305214 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:47.315852 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Usage tracker for resource:floatingip and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:47.320976 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5ee8bf2-153f-4e2f-891d-42fc26fa6f04 req-18794c16-78f0-4f57-8c8b-1b4968bbfcc8 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:47.323609 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e5ee8bf2-153f-4e2f-891d-42fc26fa6f04 req-18794c16-78f0-4f57-8c8b-1b4968bbfcc8 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 944 time: 0.2746587
May 27 09:27:47.324776 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:47.339420 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-40329ab5-7093-4afa-92be-87374c079c70 req-ed5f9eca-2f29-415f-b4e7-9d1271aec2cb tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Synchronizing usage tracker for tenant:e165c54223b24166b6856b6f285c4bca on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:47.386945 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:47.407404 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 2890994f-299e-4a4d-8e0a-945b6c38ecfe, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=2890994f-299e-4a4d-8e0a-945b6c38ecfe,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:47.421660 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:47.426495 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:47.435441 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:47.477803 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-40329ab5-7093-4afa-92be-87374c079c70 req-ed5f9eca-2f29-415f-b4e7-9d1271aec2cb tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Unset dirty status for tenant:e165c54223b24166b6856b6f285c4bca on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:47.479837 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-ed5f9eca-2f29-415f-b4e7-9d1271aec2cb tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&fields=id HTTP/1.1" status: 200  len: 255 time: 0.4864085
May 27 09:27:47.504560 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e5ee8bf2-153f-4e2f-891d-42fc26fa6f04 req-ccd2aa46-10bc-4384-8575-903fd3ccb224 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1643364
May 27 09:27:47.837304 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-6b4478b2-bb16-498d-990a-99d0c36e7307 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--814190656&fields=id&tenant_id=3b2fb81840c64238b0ae0db08ca9b139 HTTP/1.1" status: 200  len: 267 time: 0.1086617
May 27 09:27:47.945211 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port da4faf50-f101-4d33-a820-86240054a093, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=da4faf50-f101-4d33-a820-86240054a093,segment=NetworkSegment(519332c4-0201-4d92-9424-ec0b1d1407e4),segment_id=519332c4-0201-4d92-9424-ec0b1d1407e4)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:48.009933 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:48.011411 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=2890994f-299e-4a4d-8e0a-945b6c38ecfe,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:48.033790 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.598s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:48.038204 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 7515b299-be21-49ae-9c90-975237275947 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:48.098944 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': 'da4faf50-f101-4d33-a820-86240054a093', 'network_id': '614fa2b9-1890-4e8d-9f9a-f79aaebf515d', 'port_id': 'da4faf50-f101-4d33-a820-86240054a093', 'mac_address': 'fa:16:3e:79:89:f5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 387, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fe9e7e1e-674a-4cd2-835e-ab14693282cf', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:27:48.103113 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecaa6640>, [{'id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-router', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89'}], 'enable_snat': True}, 'gw_port_id': '8262e930-0850-4885-81df-37a7db4afa6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:39Z', 'revision_number': 4, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'gw_port': {'id': '8262e930-0850-4885-81df-37a7db4afa6d', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:22:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:10Z', 'updated_at': '2021-05-27T09:27:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'd9d28434-09e7-48ed-9844-ef965b2d090b', 'name': '', 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'mac_address': 'fa:16:3e:d8:d4:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_interface', 'standard_attr_id': 116, 'fixed_ips': [{'subnet_id': '2171d20e-0746-4ea0-9aa2-e8adfb7e51ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:34Z', 'updated_at': '2021-05-27T09:27:40Z', 'revision_number': 2, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'subnets': [{'id': '2171d20e-0746-4ea0-9aa2-e8adfb7e51ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:48.178474 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Checking router: fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:27:48.178474 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Updating router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 port d9d28434-09e7-48ed-9844-ef965b2d090b binding host dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:27:48.383231 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:48.389728 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Allocated IP 172.27.1.79 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/35b194f3-33d3-4bb0-8ff6-6d7b89f64157) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:48.434548 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:48.440857 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-cbebacad-c103-4f66-9066-a8d31534609b service neutron] 10.222.0.30 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.9336848
May 27 09:27:48.502334 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id da4faf50-f101-4d33-a820-86240054a093 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:27:48.823973 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:48.932110 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:48.944773 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-2cc51e89-8f18-4aae-b816-c4241267c177 service neutron] 10.222.0.30 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5027049
May 27 09:27:48.957859 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-3c175eec-79ed-4c43-8827-dfa80dbf760d tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:48.959977 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-3c175eec-79ed-4c43-8827-dfa80dbf760d tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/networks?id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 200  len: 811 time: 1.1227994
May 27 09:27:48.963550 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:48.988194 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-6edee169-14b2-4a5b-bb42-afe911649e52 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/quotas/3b2fb81840c64238b0ae0db08ca9b139 HTTP/1.1" status: 200  len: 375 time: 0.0176971
May 27 09:27:49.047299 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port da4faf50-f101-4d33-a820-86240054a093, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=da4faf50-f101-4d33-a820-86240054a093,segment=NetworkSegment(519332c4-0201-4d92-9424-ec0b1d1407e4),segment_id=519332c4-0201-4d92-9424-ec0b1d1407e4)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:49.095815 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:49.107350 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:49.115430 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:49.126276 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:49.129435 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:49.145849 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'Port': ['ID=35b194f3-33d3-4bb0-8ff6-6d7b89f64157,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:49.159866 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:49.187804 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-df45ea1c-a3f7-47f6-858a-25b52ae2c36e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&fields=id HTTP/1.1" status: 200  len: 348 time: 0.1881559
May 27 09:27:49.197996 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 7515b299-be21-49ae-9c90-975237275947 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:49.198873 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:49.210966 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:49.420517 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:49.546309 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=da4faf50-f101-4d33-a820-86240054a093,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:49.579261 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['da4faf50-f101-4d33-a820-86240054a093'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:27:49.617466 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.510s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:49.743888 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-bdaa2bbd-2255-4a31-aeff-b8f9ed17c3b6 service neutron] 10.222.0.30 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5216119
May 27 09:27:49.873718 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:49.894810 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:49.907466 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:50.056977 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-a94d1a17-774e-456e-a732-df68fad7a806 service neutron] 10.222.0.30 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2936103
May 27 09:27:50.096682 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec89e4e-331e-4a9b-9b06-c1bea56d8dfb req-66ad9ba4-f620-40b5-bf70-232c7f7c4f0a tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:50.099342 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ec89e4e-331e-4a9b-9b06-c1bea56d8dfb req-66ad9ba4-f620-40b5-bf70-232c7f7c4f0a tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 945 time: 0.6455588
May 27 09:27:50.109537 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Notify callbacks [] for port, precommit_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:50.190679 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Transition to ACTIVE for port object d9d28434-09e7-48ed-9844-ef965b2d090b will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:50.216638 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:50.220557 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:50.228126 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:50.280327 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ec89e4e-331e-4a9b-9b06-c1bea56d8dfb req-2c725bee-41dc-4b49-a7b2-6079d84328d3 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1566024
May 27 09:27:50.390304 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'Port': ['ID=35b194f3-33d3-4bb0-8ff6-6d7b89f64157,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:50.447949 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.539s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:50.452857 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:50.456225 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 3.1716735
May 27 09:27:50.486942 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-086f1751-f1fd-466f-8976-1e74cd1820e1 None None] Pushing event updated for resources: {'Port': ['ID=d9d28434-09e7-48ed-9844-ef965b2d090b,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:50.561431 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-086f1751-f1fd-466f-8976-1e74cd1820e1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.333s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:50.680393 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Attempting to bind port d9d28434-09e7-48ed-9844-ef965b2d090b on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:50.680794 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Attempting to bind port d9d28434-09e7-48ed-9844-ef965b2d090b by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:50.681174 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Attempting to bind port d9d28434-09e7-48ed-9844-ef965b2d090b on network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:50.691341 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:50.691796 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Checking segment: {'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:50.692220 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:50.692637 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Bound using segment: {'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:50.693146 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Bound port: d9d28434-09e7-48ed-9844-ef965b2d090b, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:50.694113 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:50.806878 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f61f20ef-b3cc-4cda-a104-fc2eb4a049ee req-48978b3c-92f1-447a-bf34-00a8633a7077 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:50.808696 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f61f20ef-b3cc-4cda-a104-fc2eb4a049ee req-48978b3c-92f1-447a-bf34-00a8633a7077 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 945 time: 0.1801083
May 27 09:27:50.964694 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f61f20ef-b3cc-4cda-a104-fc2eb4a049ee req-cc476e6c-b988-45f8-8cfb-ab1809ceade4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1468534
May 27 09:27:50.987920 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] For port d9d28434-09e7-48ed-9844-ef965b2d090b, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:27:50.996611 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] For port d9d28434-09e7-48ed-9844-ef965b2d090b, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=d9d28434-09e7-48ed-9844-ef965b2d090b,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:27:51.016199 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '771c169e-ea25-4862-a057-69f990bb8eab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2890994f-299e-4a4d-8e0a-945b6c38ecfe', 'code': 200}
May 27 09:27:51.026988 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:51.037487 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:51.132536 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device da4faf50-f101-4d33-a820-86240054a093 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:51.261907 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3348eee8-47c1-4d68-ba3f-b25bbfe9f0e3 req-05b1c399-919f-4451-ac5e-ff3d3d1fb376 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 210 time: 0.1043942
May 27 09:27:51.265227 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-efcb58f5-45fb-4e3d-82ad-9f0a2676c1c8 req-30217138-d41a-40fb-8c44-a7670673129a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 210 time: 0.1981318
May 27 09:27:51.670354 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Routers {'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:27:51.671347 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecaa6640>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:27:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:51.772478 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port da4faf50-f101-4d33-a820-86240054a093 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:51.803662 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port da4faf50-f101-4d33-a820-86240054a093 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:51.807395 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:51.814174 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa13d17-ac6a-41ac-8f1f-20aa0db0acf6 req-8c3a1061-c748-48b4-8d0a-49f8a2059b89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:51.822904 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-caa13d17-ac6a-41ac-8f1f-20aa0db0acf6 req-8c3a1061-c748-48b4-8d0a-49f8a2059b89 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 1098 time: 0.3990941
May 27 09:27:51.900753 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-caa13d17-ac6a-41ac-8f1f-20aa0db0acf6 req-45b79cdc-632f-4f25-b8cc-e1ee011451e3 service neutron] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:51.953617 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-f50ef50c-b164-4dba-b1bf-f390d97ef8ac tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Synchronizing usage tracker for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:security_group {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:51.975796 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-caa13d17-ac6a-41ac-8f1f-20aa0db0acf6 req-45b79cdc-632f-4f25-b8cc-e1ee011451e3 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:51.985821 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-caa13d17-ac6a-41ac-8f1f-20aa0db0acf6 req-45b79cdc-632f-4f25-b8cc-e1ee011451e3 service neutron] Usage tracker for resource:security_group_rule and tenant:5817a8eaf2404d9c9c504916e3bd630c is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:51.991198 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-caa13d17-ac6a-41ac-8f1f-20aa0db0acf6 req-45b79cdc-632f-4f25-b8cc-e1ee011451e3 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:52.000345 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-086f1751-f1fd-466f-8976-1e74cd1820e1 None None] Pushing event updated for resources: {'Port': ['ID=d9d28434-09e7-48ed-9844-ef965b2d090b,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:52.004568 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-caa13d17-ac6a-41ac-8f1f-20aa0db0acf6 req-45b79cdc-632f-4f25-b8cc-e1ee011451e3 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:52.013207 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-086f1751-f1fd-466f-8976-1e74cd1820e1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.975s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:52.065048 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40329ab5-7093-4afa-92be-87374c079c70 req-e4fdcdd2-7eb0-4156-9ca9-c74a38b2a617 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:52.067704 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-e4fdcdd2-7eb0-4156-9ca9-c74a38b2a617 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.11 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 819 time: 0.5511432
May 27 09:27:52.088169 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Request body: {'port': {'device_id': '4f6ec86c-fb8e-442b-b20f-de58d342e4c8', 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80', 'admin_state_up': True, 'tenant_id': 'e165c54223b24166b6856b6f285c4bca'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:52.122935 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-f50ef50c-b164-4dba-b1bf-f390d97ef8ac tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Unset dirty status for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:security_group {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:52.133899 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-f50ef50c-b164-4dba-b1bf-f390d97ef8ac tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1319276584&fields=id&tenant_id=f631f0ceb250483891019fb79b2e6b83 HTTP/1.1" status: 200  len: 267 time: 0.3471880
May 27 09:27:52.247148 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-caa13d17-ac6a-41ac-8f1f-20aa0db0acf6 req-45b79cdc-632f-4f25-b8cc-e1ee011451e3 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:52.258242 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-caa13d17-ac6a-41ac-8f1f-20aa0db0acf6 req-45b79cdc-632f-4f25-b8cc-e1ee011451e3 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:52.277768 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:52.287559 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-caa13d17-ac6a-41ac-8f1f-20aa0db0acf6 req-45b79cdc-632f-4f25-b8cc-e1ee011451e3 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4584615
May 27 09:27:52.336456 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b79cdc-632f-4f25-b8cc-e1ee011451e3 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=2216d6ea-bd5c-46d8-b77b-bd92d41bf119,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:52.348522 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-45b79cdc-632f-4f25-b8cc-e1ee011451e3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:52.423146 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:52.453887 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] Set router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:27:52.573501 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b91c215-c57c-453e-ac72-290a1f8fccf9 req-eff1dee3-ef26-4df7-96f2-fd7464f816a2 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:52.576641 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7b91c215-c57c-453e-ac72-290a1f8fccf9 req-eff1dee3-ef26-4df7-96f2-fd7464f816a2 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 945 time: 0.7906888
May 27 09:27:52.602252 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port da4faf50-f101-4d33-a820-86240054a093, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=da4faf50-f101-4d33-a820-86240054a093,segment=NetworkSegment(519332c4-0201-4d92-9424-ec0b1d1407e4),segment_id=519332c4-0201-4d92-9424-ec0b1d1407e4)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:52.692796 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-9f289626-5c4c-4e6a-80a7-5950f20fe2ff tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:52.695898 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-9f289626-5c4c-4e6a-80a7-5950f20fe2ff tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 816 time: 0.5606997
May 27 09:27:52.706448 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:52.715941 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:52.801237 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:52.826314 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7b91c215-c57c-453e-ac72-290a1f8fccf9 req-ffe68b50-6275-4685-810f-86c77e553cbd tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2245235
May 27 09:27:52.859794 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-6ce55d74-b137-412e-93ce-f3a91faad4dc tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/quotas/f631f0ceb250483891019fb79b2e6b83 HTTP/1.1" status: 200  len: 375 time: 0.1112506
May 27 09:27:52.974962 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:53.026162 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Made reservation on behalf of e165c54223b24166b6856b6f285c4bca for: {'port': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:53.041342 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf0e942c-e831-44eb-9aad-239ffadc6bbe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da4faf50-f101-4d33-a820-86240054a093'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:27:53.050411 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:53.062920 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=da4faf50-f101-4d33-a820-86240054a093,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:53.070395 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.354s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:53.373149 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecaa6640>, [{'id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-router', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89'}], 'enable_snat': True}, 'gw_port_id': '8262e930-0850-4885-81df-37a7db4afa6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:39Z', 'revision_number': 4, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'gw_port': {'id': '8262e930-0850-4885-81df-37a7db4afa6d', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:22:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:10Z', 'updated_at': '2021-05-27T09:27:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'd9d28434-09e7-48ed-9844-ef965b2d090b', 'name': '', 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'mac_address': 'fa:16:3e:d8:d4:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_interface', 'standard_attr_id': 116, 'fixed_ips': [{'subnet_id': '2171d20e-0746-4ea0-9aa2-e8adfb7e51ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:34Z', 'updated_at': '2021-05-27T09:27:50Z', 'revision_number': 4, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'subnets': [{'id': '2171d20e-0746-4ea0-9aa2-e8adfb7e51ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:27:53.393152 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-db3fbbaf-0de9-4326-9665-689ac7dc8614 None None] The sync data for ids ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'] in dv-cinder-772623-6-iscsi is: [{'id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-router', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89'}], 'enable_snat': True}, 'gw_port_id': '8262e930-0850-4885-81df-37a7db4afa6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:39Z', 'revision_number': 4, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'gw_port': {'id': '8262e930-0850-4885-81df-37a7db4afa6d', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:22:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:10Z', 'updated_at': '2021-05-27T09:27:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'd9d28434-09e7-48ed-9844-ef965b2d090b', 'name': '', 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'mac_address': 'fa:16:3e:d8:d4:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_interface', 'standard_attr_id': 116, 'fixed_ips': [{'subnet_id': '2171d20e-0746-4ea0-9aa2-e8adfb7e51ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:34Z', 'updated_at': '2021-05-27T09:27:50Z', 'revision_number': 4, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'subnets': [{'id': '2171d20e-0746-4ea0-9aa2-e8adfb7e51ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:27:53.436192 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-f8205a92-abad-4cd0-aa4c-30521a2f1a83 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:53.437727 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-f8205a92-abad-4cd0-aa4c-30521a2f1a83 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Synchronizing usage tracker for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:network {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:53.466533 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-f8205a92-abad-4cd0-aa4c-30521a2f1a83 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Unset dirty status for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:network {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:53.468983 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-f8205a92-abad-4cd0-aa4c-30521a2f1a83 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.11 "GET /v2.0/networks?id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 200  len: 811 time: 0.2481685
May 27 09:27:53.741440 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-0f25560c-02f7-4084-abb1-9ee8ff6e1b52 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&fields=id HTTP/1.1" status: 200  len: 348 time: 0.8712761
May 27 09:27:53.836805 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-578fc406-b110-4503-814a-090ea1474bee tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Synchronizing usage tracker for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:security_group {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:53.920537 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-578fc406-b110-4503-814a-090ea1474bee tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Unset dirty status for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:security_group {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:53.923548 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-578fc406-b110-4503-814a-090ea1474bee tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3b2fb81840c64238b0ae0db08ca9b139 HTTP/1.1" status: 200  len: 379 time: 0.4415946
May 27 09:27:53.956115 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'port': {'device_id': 'b428e51d-c310-481e-9c08-42415117a7a3', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'admin_state_up': True, 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'security_groups': ['a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b']}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:54.144650 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-f46bd385-b70e-4dff-bdb9-9c1e64286971 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:54.158807 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-f46bd385-b70e-4dff-bdb9-9c1e64286971 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 819 time: 1.0873566
May 27 09:27:54.326023 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device d9d28434-09e7-48ed-9844-ef965b2d090b up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:54.465889 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-bd50300b-4de7-4a95-9665-080ae6abf970 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/quotas/e165c54223b24166b6856b6f285c4bca HTTP/1.1" status: 200  len: 375 time: 0.0973260
May 27 09:27:54.522222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:27:54.542681 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Usage tracker for resource:port and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:27:54.550587 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Quota usage for port was recalculated. Used quota:3. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:27:54.566023 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port d9d28434-09e7-48ed-9844-ef965b2d090b completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:54.576438 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:27:54.577287 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port d9d28434-09e7-48ed-9844-ef965b2d090b triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:54.577858 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:54.610758 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Made reservation on behalf of 3b2fb81840c64238b0ae0db08ca9b139 for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:27:54.614882 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:54.697100 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Allocated IP 172.20.0.8 (ca288a2a-9fc5-474b-a3f5-732ddd5ede80/2171d20e-0746-4ea0-9aa2-e8adfb7e51ac/61f95559-dc0a-4418-af09-fd9c84d973ac) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:54.744357 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-769c0aaf-c9bb-47b3-99b3-9d3f7d2a1a91 service neutron] 10.222.0.30 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.9050488
May 27 09:27:54.818080 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:54.883104 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port d9d28434-09e7-48ed-9844-ef965b2d090b, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=d9d28434-09e7-48ed-9844-ef965b2d090b,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:27:54.890742 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:54.893359 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:55.019179 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Allocated IP 172.20.0.4 (bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6/b2c650ce-3329-4545-aaac-c69109472b2b/5c6508e0-a5e3-49f0-adc0-fd87845be346) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:27:55.040072 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=d9d28434-09e7-48ed-9844-ef965b2d090b,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:55.056469 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:55.181894 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-57b431e6-9a48-4e2b-a2b8-fcb5903d4d5f service neutron] 10.222.0.30 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4199121
May 27 09:27:55.365223 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:55.379146 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-40e85820-a5a1-4a29-8c5f-cbfe14736163 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&fields=id HTTP/1.1" status: 200  len: 255 time: 0.8379519
May 27 09:27:55.420821 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Transition to ACTIVE for port object 5c6508e0-a5e3-49f0-adc0-fd87845be346 will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:55.497317 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:55.520273 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:55.627800 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:55.644839 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:55.655212 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:55.675945 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:55.697574 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:55.753553 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'Port': ['ID=5c6508e0-a5e3-49f0-adc0-fd87845be346,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:55.770547 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.251s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:55.837062 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.9055967
May 27 09:27:55.851707 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Request body: {'port': {'device_id': 'b428e51d-c310-481e-9c08-42415117a7a3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:56.174536 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-3f958be4-d8f8-436b-a91a-766176050fed None None] Provisioning for port 5c6508e0-a5e3-49f0-adc0-fd87845be346 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:27:56.192282 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:56.211271 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-3f958be4-d8f8-436b-a91a-766176050fed None None] Provisioning complete for port 5c6508e0-a5e3-49f0-adc0-fd87845be346 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:56.216302 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3f958be4-d8f8-436b-a91a-766176050fed None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:56.250424 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:56.328447 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device d9d28434-09e7-48ed-9844-ef965b2d090b up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:27:56.341392 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-0234c4ac-159b-49c5-8fb5-c26a898c6ff7 service neutron] 10.222.0.30 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.9510527
May 27 09:27:56.604374 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:56.630624 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdd7b327-c759-4e76-aaa7-6c91e9df81d0 req-e8702aa2-5417-41e0-b0f5-0a9745cfa6c0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:56.640462 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fdd7b327-c759-4e76-aaa7-6c91e9df81d0 req-e8702aa2-5417-41e0-b0f5-0a9745cfa6c0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 945 time: 0.4331541
May 27 09:27:56.646113 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:56.670079 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:56.707986 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-17798b42-eb44-4861-90c8-784256fe44b1 service neutron] 10.222.0.30 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3467889
May 27 09:27:56.739562 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:27:56.748186 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:27:56.761611 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:27:56.768285 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:56.769395 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:56.790994 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-3f958be4-d8f8-436b-a91a-766176050fed None None] Port 5c6508e0-a5e3-49f0-adc0-fd87845be346 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:27:56.831570 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port d9d28434-09e7-48ed-9844-ef965b2d090b triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:27:56.832270 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:56.836681 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Pushing event updated for resources: {'Port': ['ID=61f95559-dc0a-4418-af09-fd9c84d973ac,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:56.862111 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fdd7b327-c759-4e76-aaa7-6c91e9df81d0 req-9369ce0c-0732-4c8f-87ff-2f6de4e6198c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2203102
May 27 09:27:56.864649 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:56.905276 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 4.8269594
May 27 09:27:56.919193 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Request body: {'port': {'device_id': '4f6ec86c-fb8e-442b-b20f-de58d342e4c8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:27:57.202058 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:57.489186 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5c6508e0-a5e3-49f0-adc0-fd87845be346 {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:27:57.535115 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:57.566862 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Transition to ACTIVE for port object 5c6508e0-a5e3-49f0-adc0-fd87845be346 will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:57.588119 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf0e942c-e831-44eb-9aad-239ffadc6bbe', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da4faf50-f101-4d33-a820-86240054a093', 'code': 200}
May 27 09:27:57.590350 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:57.609129 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:58.181830 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Pushing event updated for resources: {'Port': ['ID=5c6508e0-a5e3-49f0-adc0-fd87845be346,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:58.211616 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.602s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:58.218395 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.11', 57374) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:58.234554 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4c15f2a-12a6-4d2f-a1fe-beca10a357ab req-fa8d568f-2c0d-439a-aa54-8b9a4dd51df0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:58.236810 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b4c15f2a-12a6-4d2f-a1fe-beca10a357ab req-fa8d568f-2c0d-439a-aa54-8b9a4dd51df0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 931 time: 1.0361531
May 27 09:27:58.239268 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Attempting to bind port 5c6508e0-a5e3-49f0-adc0-fd87845be346 on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:58.241703 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Attempting to bind port 5c6508e0-a5e3-49f0-adc0-fd87845be346 by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:58.242568 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Attempting to bind port 5c6508e0-a5e3-49f0-adc0-fd87845be346 on network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:58.358132 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Port 5c6508e0-a5e3-49f0-adc0-fd87845be346 on network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:27:58.362483 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Attempting to bind port 5c6508e0-a5e3-49f0-adc0-fd87845be346 on network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:58.424266 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:58.424266 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Checking segment: {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:58.424266 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Bound using segment: {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:58.424266 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Bound port: 5c6508e0-a5e3-49f0-adc0-fd87845be346, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:58.424266 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:58.638164 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] For port 5c6508e0-a5e3-49f0-adc0-fd87845be346, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:27:58.647466 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] For port 5c6508e0-a5e3-49f0-adc0-fd87845be346, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=5c6508e0-a5e3-49f0-adc0-fd87845be346,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:27:58.656850 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:58.677146 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ce3fd2d1-7f02-4d4d-91ef-a9030ae0383f service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:58.692186 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b4c15f2a-12a6-4d2f-a1fe-beca10a357ab req-db70cbc5-d918-4764-a275-00914395876c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.4375894
May 27 09:27:58.730103 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c1a6c2b-a6b4-4409-a0a3-01bc13345c02 req-f8e6a542-0ead-492c-a12b-1a0fb73eaa5a tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:58.732697 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5c1a6c2b-a6b4-4409-a0a3-01bc13345c02 req-f8e6a542-0ead-492c-a12b-1a0fb73eaa5a tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 946 time: 0.8223634
May 27 09:27:58.825463 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5c1a6c2b-a6b4-4409-a0a3-01bc13345c02 req-9d3ccd2d-0cda-46c8-b98c-edf1acbf3800 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0824142
May 27 09:27:58.893912 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Pushing event updated for resources: {'Port': ['ID=5c6508e0-a5e3-49f0-adc0-fd87845be346,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:58.899007 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:58.924641 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:58.925303 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4545a162-b732-4715-b501-29e6d1fe51b2 req-9c6d3436-add0-446d-b9e6-d12d9ce711ff tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 210 time: 0.0909657
May 27 09:27:58.926158 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:58.929970 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] 10.222.0.11 "PUT /v2.0/ports/5c6508e0-a5e3-49f0-adc0-fd87845be346 HTTP/1.1" status: 200  len: 1093 time: 3.0849850
May 27 09:27:58.934643 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b428e51d-c310-481e-9c08-42415117a7a3', 'tag': '5c6508e0-a5e3-49f0-adc0-fd87845be346'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:27:58.979892 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f7b6b7d-cba6-43df-920c-ff191ed2929f req-b91a4f3c-d642-4d23-832a-0a7b8a340d93 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:58.981756 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-1f7b6b7d-cba6-43df-920c-ff191ed2929f req-b91a4f3c-d642-4d23-832a-0a7b8a340d93 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 1099 time: 0.7493238
May 27 09:27:59.085858 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.11', 57378) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:59.271271 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b428e51d-c310-481e-9c08-42415117a7a3', 'tag': '5c6508e0-a5e3-49f0-adc0-fd87845be346', 'status': 'completed', 'code': 200}
May 27 09:27:59.289952 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 61f95559-dc0a-4418-af09-fd9c84d973ac {{(pid=91821) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:27:59.308185 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:59.327312 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Transition to ACTIVE for port object 61f95559-dc0a-4418-af09-fd9c84d973ac will not be triggered until provisioned by entity L2. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:27:59.374695 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:59.385656 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-903edb58-0d78-4df4-a321-b7c8f432150e req-c89915c3-aa6d-4c0d-88be-1aeb6413da03 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Synchronizing usage tracker for tenant:e165c54223b24166b6856b6f285c4bca on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:59.390820 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-09fa03ac-b5bd-4742-aae2-be0a0ad5f0d1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:27:59.460763 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47844) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:27:59.583087 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-1f7b6b7d-cba6-43df-920c-ff191ed2929f req-bae9bdf5-5fd6-424e-8339-ee52b5f00f07 service neutron] Synchronizing usage tracker for tenant:5817a8eaf2404d9c9c504916e3bd630c on resource:security_group {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:27:59.594439 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-903edb58-0d78-4df4-a321-b7c8f432150e req-c89915c3-aa6d-4c0d-88be-1aeb6413da03 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Unset dirty status for tenant:e165c54223b24166b6856b6f285c4bca on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:59.595474 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-903edb58-0d78-4df4-a321-b7c8f432150e req-c89915c3-aa6d-4c0d-88be-1aeb6413da03 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 210 time: 0.2664163
May 27 09:27:59.609160 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Pushing event updated for resources: {'Port': ['ID=61f95559-dc0a-4418-af09-fd9c84d973ac,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:27:59.612866 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:27:59.715008 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Attempting to bind port 61f95559-dc0a-4418-af09-fd9c84d973ac on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:27:59.715008 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Attempting to bind port 61f95559-dc0a-4418-af09-fd9c84d973ac by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:27:59.715008 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Attempting to bind port 61f95559-dc0a-4418-af09-fd9c84d973ac on network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:59.723042 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Port 61f95559-dc0a-4418-af09-fd9c84d973ac on network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:27:59.723402 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Attempting to bind port 61f95559-dc0a-4418-af09-fd9c84d973ac on network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:27:59.731632 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:27:59.731990 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Checking segment: {'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:27:59.732521 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Bound using segment: {'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:27:59.732980 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Bound port: 61f95559-dc0a-4418-af09-fd9c84d973ac, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'}}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:27:59.734020 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:27:59.779792 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-c3f04f80-89c7-43d1-9f5b-eb96c0b376de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:27:59.783728 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-c3f04f80-89c7-43d1-9f5b-eb96c0b376de service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 1096 time: 0.6847742
May 27 09:27:59.783728 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-1f7b6b7d-cba6-43df-920c-ff191ed2929f req-bae9bdf5-5fd6-424e-8339-ee52b5f00f07 service neutron] Unset dirty status for tenant:5817a8eaf2404d9c9c504916e3bd630c on resource:security_group {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:27:59.789978 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-1f7b6b7d-cba6-43df-920c-ff191ed2929f req-bae9bdf5-5fd6-424e-8339-ee52b5f00f07 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.7991946
May 27 09:27:59.985705 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-29bc1785-975f-4c95-8189-48bf9db1ead9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:00.013477 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] For port 61f95559-dc0a-4418-af09-fd9c84d973ac, host hv-cinder-77262, cleared binding levels {{(pid=91821) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:28:00.020997 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-e81a80ff-844f-4324-a322-10fbdd80cc1c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:00.023027 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-e81a80ff-844f-4324-a322-10fbdd80cc1c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Synchronizing usage tracker for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:network {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:28:00.046022 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] For port 61f95559-dc0a-4418-af09-fd9c84d973ac, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=61f95559-dc0a-4418-af09-fd9c84d973ac,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91821) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:28:00.099050 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-29bc1785-975f-4c95-8189-48bf9db1ead9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:00.101132 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-f5ef1c06-2086-45f9-8b1f-233b140c1da7 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5c6508e0-a5e3-49f0-adc0-fd87845be346 HTTP/1.1" status: 200  len: 217 time: 0.2642114
May 27 09:28:00.106071 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-29bc1785-975f-4c95-8189-48bf9db1ead9 admin admin] Usage tracker for resource:security_group_rule and tenant:06485477811244489f5829af15a064c0 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:00.111352 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-29bc1785-975f-4c95-8189-48bf9db1ead9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:00.122181 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-29bc1785-975f-4c95-8189-48bf9db1ead9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:00.150965 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47868) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:00.188249 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:00.243261 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e8a0ae43-b719-47ed-aa04-778d4f4c5c65 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:00.288125 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:00.288125 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:00.289552 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] 10.222.0.11 "PUT /v2.0/ports/61f95559-dc0a-4418-af09-fd9c84d973ac HTTP/1.1" status: 200  len: 1093 time: 3.3756790
May 27 09:28:00.305712 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4f6ec86c-fb8e-442b-b20f-de58d342e4c8', 'tag': '61f95559-dc0a-4418-af09-fd9c84d973ac'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:00.340702 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-e81a80ff-844f-4324-a322-10fbdd80cc1c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Unset dirty status for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:network {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:28:00.342012 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-e81a80ff-844f-4324-a322-10fbdd80cc1c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.11 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 816 time: 1.3009274
May 27 09:28:00.413565 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-c0d1272b-230e-4f24-9b0d-02f152df13bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:00.415435 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-c0d1272b-230e-4f24-9b0d-02f152df13bd service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b2c650ce-3329-4545-aaac-c69109472b2b HTTP/1.1" status: 200  len: 850 time: 0.3055768
May 27 09:28:00.459584 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151291cb-4d52-42f6-8c69-d2c52f9b77b5 req-7625ab84-6e9a-4adf-b387-3b448874e67d tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:00.469931 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-151291cb-4d52-42f6-8c69-d2c52f9b77b5 req-7625ab84-6e9a-4adf-b387-3b448874e67d tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 943 time: 0.6012521
May 27 09:28:00.519976 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-ec4ee1e5-c75c-47d1-8182-930e067b11b7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Synchronizing usage tracker for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:security_group {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:28:00.533096 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-ebba4bb2-21f6-4c91-b133-bd74200cbe27 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:00.534624 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-ebba4bb2-21f6-4c91-b133-bd74200cbe27 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.11 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 819 time: 0.4862874
May 27 09:28:00.554326 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Request body: {'port': {'device_id': '8164d612-dc97-4a3e-ab3b-0b55cc6032db', 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80', 'admin_state_up': True, 'tenant_id': 'e165c54223b24166b6856b6f285c4bca'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:00.577553 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:00.591874 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-ec4ee1e5-c75c-47d1-8182-930e067b11b7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Unset dirty status for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:security_group {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:28:00.593379 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-ec4ee1e5-c75c-47d1-8182-930e067b11b7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f631f0ceb250483891019fb79b2e6b83 HTTP/1.1" status: 200  len: 380 time: 0.2347438
May 27 09:28:00.599467 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Pushing event updated for resources: {'Port': ['ID=61f95559-dc0a-4418-af09-fd9c84d973ac,revision_number=3']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:00.603249 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.360s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:00.637228 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:00.665553 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-151291cb-4d52-42f6-8c69-d2c52f9b77b5 req-4998ff2f-348b-4c7e-8026-2f8a58416c27 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1941786
May 27 09:28:00.666859 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'port': {'device_id': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'admin_state_up': True, 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'security_groups': ['dea06109-ed5b-4c12-9420-16f8bc9a235a']}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:00.718174 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-652963ac-bb16-46c1-b0d0-a4029b1867eb req-e924ed2e-05c9-45ed-936f-dfef5c334d36 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:00.720057 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-652963ac-bb16-46c1-b0d0-a4029b1867eb req-e924ed2e-05c9-45ed-936f-dfef5c334d36 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 946 time: 0.6830971
May 27 09:28:00.727112 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Usage tracker for resource:security_group_rule and tenant:66427b182cba44209ea0288420e765ab is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:00.733475 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:00.755266 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:00.790090 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-29bc1785-975f-4c95-8189-48bf9db1ead9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:00.796984 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40329ab5-7093-4afa-92be-87374c079c70 req-c6226f2a-3a7d-40b6-bbed-c81d5c8b1f27 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:00.798979 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-c6226f2a-3a7d-40b6-bbed-c81d5c8b1f27 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 1096 time: 0.4371302
May 27 09:28:00.810686 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-29bc1785-975f-4c95-8189-48bf9db1ead9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:00.881075 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-70111326-b0b1-423b-8ee9-a31ac6652f4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:00.883720 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-70111326-b0b1-423b-8ee9-a31ac6652f4c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.4527352
May 27 09:28:00.907170 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:00.969033 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-7fe2d11f-7d29-4178-b920-89c64c55ae92 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=61f95559-dc0a-4418-af09-fd9c84d973ac HTTP/1.1" status: 200  len: 217 time: 0.1615732
May 27 09:28:01.036402 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:01.039739 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-da799d52-9fb9-4e43-b288-bbdd41ade1ea req-a49d83a6-5166-4c1b-b298-b96d58d58c2e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 210 time: 0.2239802
May 27 09:28:01.043156 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-652963ac-bb16-46c1-b0d0-a4029b1867eb req-a11ea39c-5420-42ad-a838-8fcad43183e0 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3001270
May 27 09:28:01.110926 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29bc1785-975f-4c95-8189-48bf9db1ead9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cbb4b993-51b4-4e25-b990-88e76858452f,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:01.118827 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-29bc1785-975f-4c95-8189-48bf9db1ead9 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=06485477811244489f5829af15a064c0&name=default HTTP/1.1" status: 200  len: 2979 time: 1.6567543
May 27 09:28:01.123612 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 47890) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:01.130366 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-29bc1785-975f-4c95-8189-48bf9db1ead9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:01.159149 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40329ab5-7093-4afa-92be-87374c079c70 req-e6e42eee-3265-4eca-bb7a-29077aa8cfff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:01.161859 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-e6e42eee-3265-4eca-bb7a-29077aa8cfff service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac HTTP/1.1" status: 200  len: 859 time: 0.1643710
May 27 09:28:01.164744 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:01.271985 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Made reservation on behalf of e165c54223b24166b6856b6f285c4bca for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:28:01.276103 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:01.277042 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-bc0690df-b785-4404-969d-6a7953ef8929 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1019950
May 27 09:28:01.283689 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4f6ec86c-fb8e-442b-b20f-de58d342e4c8', 'tag': '61f95559-dc0a-4418-af09-fd9c84d973ac', 'status': 'completed', 'code': 200}
May 27 09:28:01.288185 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:01.312579 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Usage tracker for resource:port and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:01.319504 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Quota usage for port was recalculated. Used quota:3. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:01.404012 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:01.426799 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:01.439076 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-a471a1e1-97fd-4a94-9669-b7bd9ca5aad2 service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5375187
May 27 09:28:01.481649 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-175771e7-f249-4571-acda-1a8408ed7b04 req-b9506296-1df9-4df7-80ac-1e5ac5e79ac1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 210 time: 0.0808275
May 27 09:28:01.521439 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Made reservation on behalf of f631f0ceb250483891019fb79b2e6b83 for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:28:01.527768 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:01.634653 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:01.676463 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:01.699434 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:01.721683 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5d0c2da2-3b0c-41ea-ba17-fe6a7a767d88 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:01.743426 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-b06662de-9576-41a7-a507-3cf3cc93fac2 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4569061
May 27 09:28:01.868602 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:01.924734 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-45b79cdc-632f-4f25-b8cc-e1ee011451e3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:01.945675 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=66427b182cba44209ea0288420e765ab&name=default HTTP/1.1" status: 200  len: 2979 time: 1.7823794
May 27 09:28:01.948318 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-72c68b66-4936-4059-87e6-d310e5cc0376 req-4f2c80d8-50e9-4be4-a5f5-5a67b86529ad service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4914801
May 27 09:28:01.964320 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 47906) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:01.970465 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cbb4b993-51b4-4e25-b990-88e76858452f,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:01.982793 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Allocated IP 172.20.0.2 (ca288a2a-9fc5-474b-a3f5-732ddd5ede80/2171d20e-0746-4ea0-9aa2-e8adfb7e51ac/e7cf8d12-6d8f-4d92-8664-d74ba281c8d2) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:28:02.029183 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.029924 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.030375 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.030830 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.031269 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.031801 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.032241 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.032907 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.033330 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.033790 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.034224 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.034661 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.038016 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e65bd0a-4044-44a3-ade3-f8db62c758bd,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:02.081798 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.082406 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.083010 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.084099 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.084874 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.085491 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.086100 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.086713 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.087314 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.087950 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.088537 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.090002 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:02.103083 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.381s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:02.211756 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40329ab5-7093-4afa-92be-87374c079c70 req-5c7629d4-e9df-4d6a-8ba3-c2f6ec3533b4 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4605265
May 27 09:28:02.261038 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b7f2a62-cdc4-4f29-80a9-dff3e0099879 req-edf873a5-54e5-4f73-a6ba-26b6b876f3ee tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:02.263958 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5b7f2a62-cdc4-4f29-80a9-dff3e0099879 req-edf873a5-54e5-4f73-a6ba-26b6b876f3ee tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 943 time: 0.3066022
May 27 09:28:02.385503 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.461s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:02.481894 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:02.483192 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/cbb4b993-51b4-4e25-b990-88e76858452f HTTP/1.1" status: 204  len: 168 time: 1.3152289
May 27 09:28:02.500251 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-de14eb61-9268-4d65-aa45-ed05c86bbd97 req-8c27364e-bd7b-4cf7-92bc-9a43e5249ea5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 210 time: 0.1310515
May 27 09:28:02.544315 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5b7f2a62-cdc4-4f29-80a9-dff3e0099879 req-8d255890-eb30-428d-9c9f-43fe2dc16b9f tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2724211
May 27 09:28:02.602548 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-131314a8-4535-4753-8b23-857438e6f26a req-1fe538f1-b500-4115-823b-562ec804b24e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:02.604655 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-131314a8-4535-4753-8b23-857438e6f26a req-1fe538f1-b500-4115-823b-562ec804b24e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 1096 time: 0.2970569
May 27 09:28:02.633117 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6fce3087-fc68-4285-9389-f80a60a49394 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:02.636007 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Allocated IP 172.20.0.12 (624aa867-a71e-4343-8899-4e49257cd000/77149737-85de-41af-b8e2-0509a46f467d/6c2d447f-c9da-40aa-a848-6fcbf0beecb3) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:28:02.706837 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:02.712680 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6fce3087-fc68-4285-9389-f80a60a49394 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:02.785448 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-805d1fdd-6993-4361-a733-00a5ce4546a5 req-61444b00-b563-4f84-b52c-9c252d75ce4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:02.787669 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-805d1fdd-6993-4361-a733-00a5ce4546a5 req-61444b00-b563-4f84-b52c-9c252d75ce4c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 1096 time: 0.7630494
May 27 09:28:02.972288 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-131314a8-4535-4753-8b23-857438e6f26a req-aaff5cfb-4098-429d-92f1-9e87f24144ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:02.974233 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-131314a8-4535-4753-8b23-857438e6f26a req-aaff5cfb-4098-429d-92f1-9e87f24144ec service neutron] 10.222.0.11 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 920 time: 0.3591998
May 27 09:28:03.067411 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dffddaa5-2336-4e9c-9aae-cfe4ae0a5354 req-d75b1cb3-cb1e-47a8-9a7e-f1ca62468d98 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 210 time: 0.0901399
May 27 09:28:03.153086 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 47924) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:03.158037 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-131314a8-4535-4753-8b23-857438e6f26a req-47b56028-6bd6-4ea8-affb-e073496b781a service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=61f95559-dc0a-4418-af09-fd9c84d973ac HTTP/1.1" status: 200  len: 217 time: 0.0888569
May 27 09:28:03.225480 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e87b090-5b2a-46c5-93db-11a76f97564d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:03.246322 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-131314a8-4535-4753-8b23-857438e6f26a req-3598bf48-6ce3-496c-b058-dc2c8390682d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:03.248016 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-131314a8-4535-4753-8b23-857438e6f26a req-3598bf48-6ce3-496c-b058-dc2c8390682d service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac HTTP/1.1" status: 200  len: 859 time: 0.0825853
May 27 09:28:03.272535 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6fce3087-fc68-4285-9389-f80a60a49394 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:03.302551 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff271f6f-7821-4952-84cc-a89f7e6c8645 req-3740a737-8c37-4206-8125-96daf79464fb tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:03.304014 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:03.304376 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ff271f6f-7821-4952-84cc-a89f7e6c8645 req-3740a737-8c37-4206-8125-96daf79464fb tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 946 time: 0.3286715
May 27 09:28:03.312705 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-131314a8-4535-4753-8b23-857438e6f26a req-8d27fc95-973e-41f9-8201-3e0a2b06a477 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0558167
May 27 09:28:03.345035 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:03.359148 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-8e87b090-5b2a-46c5-93db-11a76f97564d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:03.443208 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ff271f6f-7821-4952-84cc-a89f7e6c8645 req-17b124b4-eef4-4f27-b3cb-82d86b7a87ca tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1294439
May 27 09:28:03.446129 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-8e87b090-5b2a-46c5-93db-11a76f97564d admin admin] Usage tracker for resource:security_group_rule and tenant:1f1eedf50cbe42ffaa7978c0150dc9b2 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:03.451198 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fce3087-fc68-4285-9389-f80a60a49394 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e65bd0a-4044-44a3-ade3-f8db62c758bd,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:03.463110 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-8e87b090-5b2a-46c5-93db-11a76f97564d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:03.483022 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6fce3087-fc68-4285-9389-f80a60a49394 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:03.484910 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-805d1fdd-6993-4361-a733-00a5ce4546a5 req-9d864c5b-efdb-4bc6-a849-2b624d57d74c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:03.486868 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-805d1fdd-6993-4361-a733-00a5ce4546a5 req-9d864c5b-efdb-4bc6-a849-2b624d57d74c service neutron] 10.222.0.11 "GET /v2.0/networks?id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 200  len: 912 time: 0.6795630
May 27 09:28:03.487501 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.092s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:03.516396 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-131314a8-4535-4753-8b23-857438e6f26a req-4f227bd5-6935-4ad5-84f1-d18233c6fa82 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1880586
May 27 09:28:03.559999 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6fce3087-fc68-4285-9389-f80a60a49394 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:03.564212 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-6fce3087-fc68-4285-9389-f80a60a49394 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/0e65bd0a-4044-44a3-ade3-f8db62c758bd HTTP/1.1" status: 204  len: 168 time: 1.5880899
May 27 09:28:03.700204 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-8e87b090-5b2a-46c5-93db-11a76f97564d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:03.707438 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-131314a8-4535-4753-8b23-857438e6f26a req-b74b0228-4f24-4f30-8c96-ccd5237172d5 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1835792
May 27 09:28:03.722189 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:03.730253 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-805d1fdd-6993-4361-a733-00a5ce4546a5 req-57ff72c1-58b5-461a-b195-c27e311dd210 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5c6508e0-a5e3-49f0-adc0-fd87845be346 HTTP/1.1" status: 200  len: 217 time: 0.1832974
May 27 09:28:03.849798 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9f1db58e-3586-4624-9fde-f9ae335ba452 req-512be020-2b38-45ab-8485-0ae2981fbfd6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 210 time: 0.0573230
May 27 09:28:03.895696 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:28:03.905710 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Transition to ACTIVE for port object 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:28:03.941738 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:28:03.973205 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:28:03.980199 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11926857-f30d-42c1-bd1b-0b5d4371bc42 req-ff3be345-456b-499b-8ec2-3346718729f9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:03.982275 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-11926857-f30d-42c1-bd1b-0b5d4371bc42 req-ff3be345-456b-499b-8ec2-3346718729f9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 943 time: 0.1356370
May 27 09:28:03.983952 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:03.985050 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:03.991907 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Pushing event updated for resources: {'Port': ['ID=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:04.017811 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.530s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:04.053242 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-11926857-f30d-42c1-bd1b-0b5d4371bc42 req-ba36feaa-5aea-4860-904c-5cd3b5783c75 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0646303
May 27 09:28:04.086783 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-805d1fdd-6993-4361-a733-00a5ce4546a5 req-fcf25cda-407d-4374-9f88-053b62038080 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:04.089511 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-805d1fdd-6993-4361-a733-00a5ce4546a5 req-fcf25cda-407d-4374-9f88-053b62038080 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b2c650ce-3329-4545-aaac-c69109472b2b HTTP/1.1" status: 200  len: 850 time: 0.3188341
May 27 09:28:04.223051 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 3.6749172
May 27 09:28:04.245220 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Request body: {'port': {'device_id': '8164d612-dc97-4a3e-ab3b-0b55cc6032db', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:04.327231 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47954) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:04.353580 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c5a955f6-6833-426f-8909-b66aa8a17dd2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:04.361150 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:04.380838 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-c5a955f6-6833-426f-8909-b66aa8a17dd2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:04.389113 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-c5a955f6-6833-426f-8909-b66aa8a17dd2 admin admin] Usage tracker for resource:security_group_rule and tenant:ec4e25cd0f4040b482b9969c52391e4e is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:04.393597 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:04.393853 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-c5a955f6-6833-426f-8909-b66aa8a17dd2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:04.404379 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-c5a955f6-6833-426f-8909-b66aa8a17dd2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:04.457131 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be246d98-621e-4c18-a0ac-b6c0db1d9b31 req-5bc94c23-1695-4d33-aed9-4489cdda9360 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:04.459010 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-be246d98-621e-4c18-a0ac-b6c0db1d9b31 req-5bc94c23-1695-4d33-aed9-4489cdda9360 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 931 time: 0.1931007
May 27 09:28:04.492837 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e87b090-5b2a-46c5-93db-11a76f97564d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:04.524977 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e87b090-5b2a-46c5-93db-11a76f97564d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:04.545898 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-be246d98-621e-4c18-a0ac-b6c0db1d9b31 req-27e7b3a4-ac9e-4f49-bcf7-bc742c80441f tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Synchronizing usage tracker for tenant:e165c54223b24166b6856b6f285c4bca on resource:security_group {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:28:04.558335 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Network 624aa867-a71e-4343-8899-4e49257cd000 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:28:04.566966 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:28:04.580582 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:28:04.587174 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:04.587933 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:04.592439 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:04.617664 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'Port': ['ID=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:04.621904 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-805d1fdd-6993-4361-a733-00a5ce4546a5 req-9f5acd55-b5ce-48c4-8032-539572c88cb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:04.623497 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-805d1fdd-6993-4361-a733-00a5ce4546a5 req-9f5acd55-b5ce-48c4-8032-539572c88cb1 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.5127234
May 27 09:28:04.624387 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:04.625893 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c5a955f6-6833-426f-8909-b66aa8a17dd2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:04.633769 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6fce3087-fc68-4285-9389-f80a60a49394 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.074s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:04.639417 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c5a955f6-6833-426f-8909-b66aa8a17dd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:04.651430 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-29bc1785-975f-4c95-8189-48bf9db1ead9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:04.673815 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-be246d98-621e-4c18-a0ac-b6c0db1d9b31 req-27e7b3a4-ac9e-4f49-bcf7-bc742c80441f tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Unset dirty status for tenant:e165c54223b24166b6856b6f285c4bca on resource:security_group {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:28:04.674961 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-be246d98-621e-4c18-a0ac-b6c0db1d9b31 req-27e7b3a4-ac9e-4f49-bcf7-bc742c80441f tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1916540
May 27 09:28:04.711169 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-c5a955f6-6833-426f-8909-b66aa8a17dd2 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ec4e25cd0f4040b482b9969c52391e4e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3825681
May 27 09:28:04.715671 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47966) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:04.728845 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5a955f6-6833-426f-8909-b66aa8a17dd2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d195afb-c705-4745-8db5-6e34c58be5bc,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:04.743004 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-c5a955f6-6833-426f-8909-b66aa8a17dd2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:04.748208 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-8e87b090-5b2a-46c5-93db-11a76f97564d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=1f1eedf50cbe42ffaa7978c0150dc9b2&name=default HTTP/1.1" status: 200  len: 2979 time: 1.5882266
May 27 09:28:04.767525 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 47972) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:04.839426 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e87b090-5b2a-46c5-93db-11a76f97564d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d19f39f1-d0cd-4508-97bf-108fcf96dfc1,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:04.843560 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 4.1910605
May 27 09:28:04.844707 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8e87b090-5b2a-46c5-93db-11a76f97564d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.211s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:04.858241 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Request body: {'port': {'device_id': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:05.012579 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-83dd4279-b8a2-4002-aa2f-0e33fcfe7ff8 None None] Provisioning for port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:28:05.021417 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-83dd4279-b8a2-4002-aa2f-0e33fcfe7ff8 None None] Provisioning complete for port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:28:05.022172 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-83dd4279-b8a2-4002-aa2f-0e33fcfe7ff8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.076703 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-805d1fdd-6993-4361-a733-00a5ce4546a5 req-378579bb-7d2f-4575-9523-99c194068530 service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4330809
May 27 09:28:05.097126 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1dbed816-198b-4331-920b-4dbc9197a8b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.121033 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-83dd4279-b8a2-4002-aa2f-0e33fcfe7ff8 None None] Port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:28:05.126793 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dd7a1f13-970c-4ad7-8fbe-a9adba987185 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.168195 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1dbed816-198b-4331-920b-4dbc9197a8b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.180715 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 61f95559-dc0a-4418-af09-fd9c84d973ac details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:28:05.207317 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dd7a1f13-970c-4ad7-8fbe-a9adba987185 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.423023 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.423762 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aa01659-f49f-46f1-a035-92be8bed6c57 req-7fc29dc2-d199-46fe-b1a9-595bf38c7550 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:05.423762 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6aa01659-f49f-46f1-a035-92be8bed6c57 req-7fc29dc2-d199-46fe-b1a9-595bf38c7550 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 932 time: 0.3911624
May 27 09:28:05.486154 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b138c844-de7e-45cd-a87a-983b7d57c114 req-818324b9-dc1e-4ea3-a800-7a83fd0b7059 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:05.488657 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b138c844-de7e-45cd-a87a-983b7d57c114 req-818324b9-dc1e-4ea3-a800-7a83fd0b7059 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 943 time: 0.2927067
May 27 09:28:05.511730 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 61f95559-dc0a-4418-af09-fd9c84d973ac, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=61f95559-dc0a-4418-af09-fd9c84d973ac,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:05.513711 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1dbed816-198b-4331-920b-4dbc9197a8b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.524884 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-41a24e0e-7866-492b-af61-5d503ac68d2c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:05.534138 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '61f95559-dc0a-4418-af09-fd9c84d973ac', 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80', 'port_id': '61f95559-dc0a-4418-af09-fd9c84d973ac', 'mac_address': 'fa:16:3e:1c:52:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 373, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2171d20e-0746-4ea0-9aa2-e8adfb7e51ac', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:28:05.542785 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dd7a1f13-970c-4ad7-8fbe-a9adba987185 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.576286 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6aa01659-f49f-46f1-a035-92be8bed6c57 req-c342b2b4-fa1f-4cc6-8fae-879242bae833 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1512091
May 27 09:28:05.578487 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1dbed816-198b-4331-920b-4dbc9197a8b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d195afb-c705-4745-8db5-6e34c58be5bc,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:05.623734 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-1dbed816-198b-4331-920b-4dbc9197a8b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:05.635986 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.655791 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 61f95559-dc0a-4418-af09-fd9c84d973ac {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:28:05.658347 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-805d1fdd-6993-4361-a733-00a5ce4546a5 req-37df9d76-78bd-4ca2-9ceb-21baa46f89d8 service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5729604
May 27 09:28:05.681576 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-06d7493a-3c38-476e-bba5-2f424c3cf4c3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.125s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:05.687112 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 61f95559-dc0a-4418-af09-fd9c84d973ac, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=61f95559-dc0a-4418-af09-fd9c84d973ac,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:05.696201 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.697762 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 5c6508e0-a5e3-49f0-adc0-fd87845be346 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:28:05.703506 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:05.717793 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd7a1f13-970c-4ad7-8fbe-a9adba987185 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d19f39f1-d0cd-4508-97bf-108fcf96dfc1,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:05.720229 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dd7a1f13-970c-4ad7-8fbe-a9adba987185 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.725392 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-dd7a1f13-970c-4ad7-8fbe-a9adba987185 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d19f39f1-d0cd-4508-97bf-108fcf96dfc1 HTTP/1.1" status: 204  len: 168 time: 0.9524982
May 27 09:28:05.734114 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b138c844-de7e-45cd-a87a-983b7d57c114 req-b8a61b3c-6adb-498f-aefb-25aa388ceb6d tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2369514
May 27 09:28:05.742262 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dd7a1f13-970c-4ad7-8fbe-a9adba987185 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:05.748032 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1dbed816-198b-4331-920b-4dbc9197a8b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:05.751856 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-1dbed816-198b-4331-920b-4dbc9197a8b9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8d195afb-c705-4745-8db5-6e34c58be5bc HTTP/1.1" status: 204  len: 168 time: 1.0328295
May 27 09:28:05.995244 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=61f95559-dc0a-4418-af09-fd9c84d973ac,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:06.043329 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cb5443a-596f-428e-aacf-f8f381bfd5ae req-bf3e7ffe-5543-4e10-ab25-55735507954b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:06.053191 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0cb5443a-596f-428e-aacf-f8f381bfd5ae req-bf3e7ffe-5543-4e10-ab25-55735507954b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 931 time: 0.1502297
May 27 09:28:06.076812 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.077348 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.077563 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.077821 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.078258 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.078600 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.078932 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.079259 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.079634 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.079963 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.080288 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.080608 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:28:06.092815 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.389s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:06.128642 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0cb5443a-596f-428e-aacf-f8f381bfd5ae req-1a103974-0b2c-447a-beec-cfc2ea1fa1ab tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0740530
May 27 09:28:06.187345 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 5c6508e0-a5e3-49f0-adc0-fd87845be346, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=5c6508e0-a5e3-49f0-adc0-fd87845be346,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:06.221967 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '5c6508e0-a5e3-49f0-adc0-fd87845be346', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'port_id': '5c6508e0-a5e3-49f0-adc0-fd87845be346', 'mac_address': 'fa:16:3e:ff:42:0d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 399, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:28:06.356409 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:06.405359 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5c6508e0-a5e3-49f0-adc0-fd87845be346 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:28:06.419873 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:28:06.447788 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 5c6508e0-a5e3-49f0-adc0-fd87845be346, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=5c6508e0-a5e3-49f0-adc0-fd87845be346,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:06.455901 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:06.458218 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-99208fb7-1e65-4d80-b32a-63b86fb084e8 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:06.463769 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:06.502246 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Transition to ACTIVE for port object e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:28:06.523665 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:28:06.540292 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:06.545778 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:06.549425 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:06.580702 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=5c6508e0-a5e3-49f0-adc0-fd87845be346,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:06.587046 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:06.672772 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Transition to ACTIVE for port object 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:28:06.743454 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:06.763220 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48018) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:06.793448 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-684c4e6c-45c7-497f-a1a6-41a5cd7381ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:06.822680 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-684c4e6c-45c7-497f-a1a6-41a5cd7381ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:06.829437 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-684c4e6c-45c7-497f-a1a6-41a5cd7381ba admin admin] Usage tracker for resource:security_group_rule and tenant:79e9232f78c64828b649cdafc35eec21 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:06.831310 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['5c6508e0-a5e3-49f0-adc0-fd87845be346'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:28:06.848677 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-684c4e6c-45c7-497f-a1a6-41a5cd7381ba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:06.890443 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-684c4e6c-45c7-497f-a1a6-41a5cd7381ba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:06.984531 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Pushing event updated for resources: {'Port': ['ID=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:06.994243 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['61f95559-dc0a-4418-af09-fd9c84d973ac'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:28:07.020689 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.471s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:07.022044 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7cf9c417-6341-4051-9daa-144231eeb187 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.175s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:07.171612 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Pushing event updated for resources: {'Port': ['ID=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:07.173780 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72a80528-f59e-4386-b3ba-8cccc53a06f1 req-3d1d0834-63f8-486b-808a-4fbcc368c323 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:07.175446 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72a80528-f59e-4386-b3ba-8cccc53a06f1 req-3d1d0834-63f8-486b-808a-4fbcc368c323 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.3085196
May 27 09:28:07.184283 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:07.243998 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Attempting to bind port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:28:07.244634 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Attempting to bind port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:28:07.245174 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Attempting to bind port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 on network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:28:07.272132 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 on network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:28:07.272898 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Attempting to bind port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 on network ca288a2a-9fc5-474b-a3f5-732ddd5ede80 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:28:07.285562 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:28:07.285887 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Checking segment: {'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:28:07.289044 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Bound using segment: {'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:28:07.289756 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Bound port: e7cf8d12-6d8f-4d92-8664-d74ba281c8d2, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 373, 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:28:07.290718 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:07.310021 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Attempting to bind port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:28:07.310732 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Attempting to bind port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:28:07.311260 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Attempting to bind port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 on network 624aa867-a71e-4343-8899-4e49257cd000 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:28:07.323437 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 on network 624aa867-a71e-4343-8899-4e49257cd000 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:28:07.324358 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Attempting to bind port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 on network 624aa867-a71e-4343-8899-4e49257cd000 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:28:07.334692 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72a80528-f59e-4386-b3ba-8cccc53a06f1 req-89123662-4127-4548-968d-69ff98010d4c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1502080
May 27 09:28:07.378004 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-684c4e6c-45c7-497f-a1a6-41a5cd7381ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:07.386990 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-684c4e6c-45c7-497f-a1a6-41a5cd7381ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:07.423758 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:07.429506 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:28:07.438379 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-684c4e6c-45c7-497f-a1a6-41a5cd7381ba admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=79e9232f78c64828b649cdafc35eec21&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6688321
May 27 09:28:07.438683 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Checking segment: {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:28:07.438683 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Bound using segment: {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:28:07.438683 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Bound port: 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:28:07.438683 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:07.441390 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48030) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:07.495538 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-684c4e6c-45c7-497f-a1a6-41a5cd7381ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03607fb7-6879-4a6d-acd9-f7516fb31ff6,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:07.503590 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-684c4e6c-45c7-497f-a1a6-41a5cd7381ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:07.526819 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d4ec5ed-6dbf-489c-8243-c621bf550d6e req-a3417036-4bfa-4ca7-8a28-e2820b2cf9ec tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:07.528923 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8d4ec5ed-6dbf-489c-8243-c621bf550d6e req-a3417036-4bfa-4ca7-8a28-e2820b2cf9ec tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 944 time: 0.2892275
May 27 09:28:07.631866 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] For port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:28:07.648131 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] For port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:28:07.666926 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-afaf5938-4e19-4938-93e8-46903f51ea80 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:07.670258 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:07.677094 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:07.744022 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-afaf5938-4e19-4938-93e8-46903f51ea80 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:07.753825 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8d4ec5ed-6dbf-489c-8243-c621bf550d6e req-e3e113ae-9674-407b-ba13-f42b7fc26a9a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1551034
May 27 09:28:07.790780 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Pushing event updated for resources: {'Port': ['ID=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:07.804674 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:28:07.805245 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-992dad2d-51cc-4401-82c2-43bf1ebb32fc req-d03c83ec-c471-449c-a3d7-09dcff44eb52 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:07.807110 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-992dad2d-51cc-4401-82c2-43bf1ebb32fc req-d03c83ec-c471-449c-a3d7-09dcff44eb52 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 943 time: 0.2711666
May 27 09:28:07.829485 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:28:07.833442 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:07.838066 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:07.844911 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:07.889595 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:07.890670 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:07.892691 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] 10.222.0.11 "PUT /v2.0/ports/e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 HTTP/1.1" status: 200  len: 1093 time: 3.6555264
May 27 09:28:07.894991 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8164d612-dc97-4a3e-ab3b-0b55cc6032db', 'tag': 'e7cf8d12-6d8f-4d92-8664-d74ba281c8d2'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:07.938039 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-afaf5938-4e19-4938-93e8-46903f51ea80 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:07.957471 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:07.958459 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:07.960777 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] 10.222.0.11 "PUT /v2.0/ports/6c2d447f-c9da-40aa-a848-6fcbf0beecb3 HTTP/1.1" status: 200  len: 1094 time: 3.1072488
May 27 09:28:07.972038 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-f7bbeea2-55a5-43ef-a838-a945f6ed52a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:07.998402 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-992dad2d-51cc-4401-82c2-43bf1ebb32fc req-599360a1-0ff2-4a24-a56d-7059aa0c87bd tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1632204
May 27 09:28:08.005447 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afaf5938-4e19-4938-93e8-46903f51ea80 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03607fb7-6879-4a6d-acd9-f7516fb31ff6,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:08.041730 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-afaf5938-4e19-4938-93e8-46903f51ea80 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:08.045510 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-afaf5938-4e19-4938-93e8-46903f51ea80 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:08.050028 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-afaf5938-4e19-4938-93e8-46903f51ea80 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/03607fb7-6879-4a6d-acd9-f7516fb31ff6 HTTP/1.1" status: 204  len: 168 time: 0.6043022
May 27 09:28:08.088788 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8164d612-dc97-4a3e-ab3b-0b55cc6032db', 'tag': 'e7cf8d12-6d8f-4d92-8664-d74ba281c8d2', 'status': 'completed', 'code': 200}
May 27 09:28:08.127072 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Pushing event updated for resources: {'Port': ['ID=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:08.140926 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:08.281025 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7acd4b24-75ee-4341-8fb2-b6a2b8f0ac0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:08.282731 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-7acd4b24-75ee-4341-8fb2-b6a2b8f0ac0b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 1096 time: 0.2982728
May 27 09:28:08.441944 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-8a54ab61-07e5-457b-81a4-d5c948a5dd4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:08.446902 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-8a54ab61-07e5-457b-81a4-d5c948a5dd4d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 1097 time: 0.2931561
May 27 09:28:08.450248 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-6dcc5a69-d02e-473d-87a4-ac772f786586 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 HTTP/1.1" status: 200  len: 217 time: 0.1566198
May 27 09:28:08.504662 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-75f70614-bd0e-4bd8-8044-b43ff030885f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:08.710072 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-f76b0b84-a91a-4345-9b39-49edd65a3bb7 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3 HTTP/1.1" status: 200  len: 217 time: 0.2492204
May 27 09:28:08.775038 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a2dd5fd-720a-4af4-a469-120e8b11b435 req-9e9beda6-291a-4898-b19b-934dd02e7484 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:08.776786 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2a2dd5fd-720a-4af4-a469-120e8b11b435 req-9e9beda6-291a-4898-b19b-934dd02e7484 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.2062624
May 27 09:28:08.793071 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-139d5259-370b-4844-a26f-f5790180aaf7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:08.794811 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-139d5259-370b-4844-a26f-f5790180aaf7 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac HTTP/1.1" status: 200  len: 859 time: 0.3320320
May 27 09:28:08.846958 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-e5997276-ace6-4d83-b693-b396d13fc925 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:08.848628 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-e5997276-ace6-4d83-b693-b396d13fc925 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 200  len: 855 time: 0.1232724
May 27 09:28:08.861063 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-3ed80325-66ab-4fae-aa5e-9c6372c8fd38 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0556345
May 27 09:28:08.987741 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2a2dd5fd-720a-4af4-a469-120e8b11b435 req-95c8a917-45bb-4937-a1a3-69c3ee61af36 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1943762
May 27 09:28:09.187018 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 61f95559-dc0a-4418-af09-fd9c84d973ac up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:28:09.267770 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-212f451c-31a4-4192-ba15-c66b8041fee6 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3702450
May 27 09:28:09.272064 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-daacc8f9-f5f9-4bdc-a5eb-69aa9289925b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:09.292877 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-daacc8f9-f5f9-4bdc-a5eb-69aa9289925b service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=624aa867-a71e-4343-8899-4e49257cd000&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.4214041
May 27 09:28:09.367615 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 61f95559-dc0a-4418-af09-fd9c84d973ac completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:28:09.373659 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 61f95559-dc0a-4418-af09-fd9c84d973ac triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:28:09.374244 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:09.462935 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eec7ab3-453a-4526-bf0e-a9f00be27535 req-bf0e42ac-9c3f-4d3a-ac64-498305ec85cc tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:09.464985 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9eec7ab3-453a-4526-bf0e-a9f00be27535 req-bf0e42ac-9c3f-4d3a-ac64-498305ec85cc tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 944 time: 0.3538351
May 27 09:28:09.613918 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9eec7ab3-453a-4526-bf0e-a9f00be27535 req-de12cc36-00fd-4daa-b4d1-813badad2c88 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1354086
May 27 09:28:09.654264 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:09.666439 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d0606823-8a29-4a16-8838-8438e7ad9f10 req-547774c1-ae13-47ad-9e00-5b801b38953b service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3754857
May 27 09:28:09.675764 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-cb8b3948-8999-4da1-854b-df36c3a8c10b service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3836076
May 27 09:28:09.687488 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0d58935-6cb1-4477-a356-e205a75d3fbb req-cab872db-3bb8-4995-918a-3eb340fa3734 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:09.698744 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f0d58935-6cb1-4477-a356-e205a75d3fbb req-cab872db-3bb8-4995-918a-3eb340fa3734 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 943 time: 0.4116011
May 27 09:28:09.732888 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f6ec86c-fb8e-442b-b20f-de58d342e4c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61f95559-dc0a-4418-af09-fd9c84d973ac'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:09.769728 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 61f95559-dc0a-4418-af09-fd9c84d973ac, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=61f95559-dc0a-4418-af09-fd9c84d973ac,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:09.777260 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:09.778547 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 5c6508e0-a5e3-49f0-adc0-fd87845be346 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:28:09.816230 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f0d58935-6cb1-4477-a356-e205a75d3fbb req-58207543-d43a-4e16-b0e3-e8f12dc0f7ae tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1162276
May 27 09:28:09.828439 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:09.873230 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4f6ec86c-fb8e-442b-b20f-de58d342e4c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '61f95559-dc0a-4418-af09-fd9c84d973ac', 'code': 200}
May 27 09:28:10.010584 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4f579a23-fce5-4184-82c8-bb56bafe8f99 req-2ea74b78-cdb4-4cd8-859a-b9fc72ace967 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3232396
May 27 09:28:10.018899 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=61f95559-dc0a-4418-af09-fd9c84d973ac,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:10.020133 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-695eef8e-7836-4de0-b2d2-738944f680e4 req-a1682d44-bbac-46d8-958f-e1fc77279ebd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:10.022833 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-695eef8e-7836-4de0-b2d2-738944f680e4 req-a1682d44-bbac-46d8-958f-e1fc77279ebd service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 1096 time: 0.1462193
May 27 09:28:10.048838 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 5c6508e0-a5e3-49f0-adc0-fd87845be346 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:28:10.069559 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:10.077732 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 5c6508e0-a5e3-49f0-adc0-fd87845be346 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:28:10.079777 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:10.086131 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:28:10.090752 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:10.279666 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'status': 'completed', 'code': 200}
May 27 09:28:10.405719 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2463f08-d009-4365-bb43-9878b10ece06 req-64cf7fe0-69a6-415e-84a9-2eaf99e8f296 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:10.410183 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c2463f08-d009-4365-bb43-9878b10ece06 req-64cf7fe0-69a6-415e-84a9-2eaf99e8f296 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.2092087
May 27 09:28:10.558256 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c2463f08-d009-4365-bb43-9878b10ece06 req-3c8c1a25-4c5a-46d2-aa38-73a1756087c7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1409616
May 27 09:28:10.566451 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-695eef8e-7836-4de0-b2d2-738944f680e4 req-1c292945-59f6-4fe1-937d-e9cb4d348639 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:10.575752 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-695eef8e-7836-4de0-b2d2-738944f680e4 req-1c292945-59f6-4fe1-937d-e9cb4d348639 service neutron] 10.222.0.11 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 920 time: 0.5467608
May 27 09:28:10.586573 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:10.660891 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 5c6508e0-a5e3-49f0-adc0-fd87845be346, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=5c6508e0-a5e3-49f0-adc0-fd87845be346,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:10.668949 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:10.672652 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:10.711725 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-695eef8e-7836-4de0-b2d2-738944f680e4 req-91a98c02-bd30-45d3-969d-e9fc35992638 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 HTTP/1.1" status: 200  len: 217 time: 0.1102931
May 27 09:28:10.713691 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3104f8e7-f059-41a6-a139-12dd63bff3f1 req-56596643-a933-4fa5-9099-b0409af661db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:10.715198 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3104f8e7-f059-41a6-a139-12dd63bff3f1 req-56596643-a933-4fa5-9099-b0409af661db service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 1097 time: 0.4295311
May 27 09:28:10.777788 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=5c6508e0-a5e3-49f0-adc0-fd87845be346,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:10.783388 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:10.827114 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-695eef8e-7836-4de0-b2d2-738944f680e4 req-0697cb0d-5ee4-4f2f-9089-f509e9d79f59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:10.829445 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-695eef8e-7836-4de0-b2d2-738944f680e4 req-0697cb0d-5ee4-4f2f-9089-f509e9d79f59 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac HTTP/1.1" status: 200  len: 859 time: 0.1053131
May 27 09:28:10.885550 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b751df-90ab-44a0-8f18-40113a29f7d2 req-2632ba4f-8f3f-4e0e-ab5f-d0140eaecfda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:10.894713 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f4b751df-90ab-44a0-8f18-40113a29f7d2 req-2632ba4f-8f3f-4e0e-ab5f-d0140eaecfda service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 1098 time: 0.5556934
May 27 09:28:10.971755 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-695eef8e-7836-4de0-b2d2-738944f680e4 req-7f14023d-2fcf-4c30-bb7b-ee8a7b0c1c16 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1007996
May 27 09:28:11.125786 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48164) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:11.185587 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3700e9ae-e5f5-42d9-95d5-617387ea3cb2 req-7297e7e2-7837-4e82-85d6-490e580bacfc tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:11.187510 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3700e9ae-e5f5-42d9-95d5-617387ea3cb2 req-7297e7e2-7837-4e82-85d6-490e580bacfc tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.3289011
May 27 09:28:11.233020 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-4a4ebfe1-de14-48e7-8a27-c5b5ed943017 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:11.234918 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-4a4ebfe1-de14-48e7-8a27-c5b5ed943017 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 815 time: 0.2813957
May 27 09:28:11.291407 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-471bda55-7844-4323-bb93-e55e8c27709c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/quotas/0daf73d9a2424c3e9ccbe74a9d2d94f5 HTTP/1.1" status: 200  len: 375 time: 0.0317347
May 27 09:28:11.319477 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3104f8e7-f059-41a6-a139-12dd63bff3f1 req-b478ed09-1152-4523-8083-25e8bd7b4991 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:11.321934 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3104f8e7-f059-41a6-a139-12dd63bff3f1 req-b478ed09-1152-4523-8083-25e8bd7b4991 service neutron] 10.222.0.11 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 917 time: 0.4896200
May 27 09:28:11.333332 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3700e9ae-e5f5-42d9-95d5-617387ea3cb2 req-230a4578-411f-4968-a645-8131fc4b63a2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0969851
May 27 09:28:11.389748 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6e964c05-f957-4a56-8b6f-2cc52171bbab admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:11.432994 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-6e964c05-f957-4a56-8b6f-2cc52171bbab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:11.439953 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-6e964c05-f957-4a56-8b6f-2cc52171bbab admin admin] Usage tracker for resource:security_group_rule and tenant:b9c4cf71f782474d9ac5be984b160119 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:11.442067 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f4b751df-90ab-44a0-8f18-40113a29f7d2 req-ddf9262b-b1d4-4b5c-b804-f6537ee6e932 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5007970
May 27 09:28:11.449014 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-6e964c05-f957-4a56-8b6f-2cc52171bbab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:11.458640 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-6e964c05-f957-4a56-8b6f-2cc52171bbab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:11.468279 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:11.501946 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-c3364b50-e765-4c07-8d6d-44270e8e1740 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&fields=id HTTP/1.1" status: 200  len: 255 time: 0.1743600
May 27 09:28:11.595982 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3104f8e7-f059-41a6-a139-12dd63bff3f1 req-6316a271-4d25-457f-9828-6414ed7bc536 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3 HTTP/1.1" status: 200  len: 217 time: 0.1588857
May 27 09:28:11.642017 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48184) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:11.826053 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-51a0feea-5446-4605-8eff-0a679cce4bdf service neutron] 10.222.0.30 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3228538
May 27 09:28:11.830132 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3104f8e7-f059-41a6-a139-12dd63bff3f1 req-2e271522-1b92-4020-a3e4-d430e1117d93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:11.834407 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3104f8e7-f059-41a6-a139-12dd63bff3f1 req-2e271522-1b92-4020-a3e4-d430e1117d93 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 200  len: 855 time: 0.2302592
May 27 09:28:11.836912 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-748da6f9-5587-48a7-8dbd-eae2b21bfe96 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:11.852000 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-695eef8e-7836-4de0-b2d2-738944f680e4 req-116ec16c-f431-487c-93e5-0aed177d6e29 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.7162042
May 27 09:28:11.873995 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b428e51d-c310-481e-9c08-42415117a7a3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c6508e0-a5e3-49f0-adc0-fd87845be346'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:12.050985 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6067b8a0-d0fb-4ec1-b9c4-7a9acf47052a req-0eebae31-c25e-41c0-b95a-f5a19b5bf198 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:12.053958 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6067b8a0-d0fb-4ec1-b9c4-7a9acf47052a req-0eebae31-c25e-41c0-b95a-f5a19b5bf198 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 943 time: 0.3409164
May 27 09:28:12.073040 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3e9721a4-47a2-4f7f-b326-c306a52e7394 service neutron] 10.222.0.30 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2460129
May 27 09:28:12.089666 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-54e97ad2-31b9-4b8a-885b-6be3895c1c73 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:12.140340 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-54e97ad2-31b9-4b8a-885b-6be3895c1c73 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:12.140574 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6e964c05-f957-4a56-8b6f-2cc52171bbab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:12.180860 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-54e97ad2-31b9-4b8a-885b-6be3895c1c73 admin admin] Usage tracker for resource:security_group_rule and tenant:f7a19848c1b9453d83e057bbffa7b790 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:12.186896 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6e964c05-f957-4a56-8b6f-2cc52171bbab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:12.191135 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-54e97ad2-31b9-4b8a-885b-6be3895c1c73 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:12.222758 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-54e97ad2-31b9-4b8a-885b-6be3895c1c73 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:12.229983 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dd7a1f13-970c-4ad7-8fbe-a9adba987185 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:12.253407 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3104f8e7-f059-41a6-a139-12dd63bff3f1 req-dcf0db37-000c-49db-a720-218b5d1810d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:12.257137 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3104f8e7-f059-41a6-a139-12dd63bff3f1 req-dcf0db37-000c-49db-a720-218b5d1810d5 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=624aa867-a71e-4343-8899-4e49257cd000&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.4034858
May 27 09:28:12.321365 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-695eef8e-7836-4de0-b2d2-738944f680e4 req-9318eeaf-41e3-4fd4-ad19-319e8834f27b service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4219563
May 27 09:28:12.366460 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e964c05-f957-4a56-8b6f-2cc52171bbab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c29539a-ed6c-4334-8956-fb026cc2af7a,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:12.386226 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-6e964c05-f957-4a56-8b6f-2cc52171bbab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:12.398408 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:12.468934 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6067b8a0-d0fb-4ec1-b9c4-7a9acf47052a req-5bb63361-19f4-482a-b63e-4d663a57c3db tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3257377
May 27 09:28:12.487301 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48204) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:12.502709 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-6e964c05-f957-4a56-8b6f-2cc52171bbab admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b9c4cf71f782474d9ac5be984b160119&name=default HTTP/1.1" status: 200  len: 2979 time: 1.3751504
May 27 09:28:12.665376 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3104f8e7-f059-41a6-a139-12dd63bff3f1 req-14741e84-7880-4f15-81d0-c55455c34f5e service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3925643
May 27 09:28:12.701408 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b428e51d-c310-481e-9c08-42415117a7a3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5c6508e0-a5e3-49f0-adc0-fd87845be346', 'code': 200}
May 27 09:28:12.816691 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb44faeb-b123-45aa-bf9f-fbd55d78e8b4 req-1c180120-35f9-461e-9489-8fc1cab072e6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:12.821821 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bb44faeb-b123-45aa-bf9f-fbd55d78e8b4 req-1c180120-35f9-461e-9489-8fc1cab072e6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.2659068
May 27 09:28:12.953848 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c526acc5-5f83-4125-a3aa-bc143c34a3e5 req-32eceafc-bb47-4720-a4bf-3eb549475ce5 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 210 time: 0.1303763
May 27 09:28:13.030280 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bb44faeb-b123-45aa-bf9f-fbd55d78e8b4 req-b85df02c-fec5-4783-bb9f-9a61365e171e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1150053
May 27 09:28:13.190307 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7afa9dc1-75bc-4ff5-9970-ab0e5f40790e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.210030 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:28:13.238068 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-54e97ad2-31b9-4b8a-885b-6be3895c1c73 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.290034 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-54e97ad2-31b9-4b8a-885b-6be3895c1c73 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.298745 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7afa9dc1-75bc-4ff5-9970-ab0e5f40790e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.331312 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48230) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:13.332027 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:13.333758 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc830921-4468-44f0-b6dc-aaa9144646d1 req-bc71cd97-7178-4b8f-889e-82bc525659e2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:13.335895 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fc830921-4468-44f0-b6dc-aaa9144646d1 req-bc71cd97-7178-4b8f-889e-82bc525659e2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1918471
May 27 09:28:13.399891 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fc830921-4468-44f0-b6dc-aaa9144646d1 req-ff5e8662-880e-4539-b7e6-9ee3e23eb6f3 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0558965
May 27 09:28:13.432562 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3104f8e7-f059-41a6-a139-12dd63bff3f1 req-e62c6ff8-58b7-4bea-9f38-3817d063692a service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.7381737
May 27 09:28:13.445386 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-54e97ad2-31b9-4b8a-885b-6be3895c1c73 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=f7a19848c1b9453d83e057bbffa7b790&name=default HTTP/1.1" status: 200  len: 2979 time: 1.7956264
May 27 09:28:13.446439 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48236) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:13.451187 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54e97ad2-31b9-4b8a-885b-6be3895c1c73 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5757a5ed-ba11-4d0d-b2de-c0703c647edc,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:13.455802 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-54e97ad2-31b9-4b8a-885b-6be3895c1c73 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:13.460651 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71476a39-c4a4-4269-a659-3630290632f6 req-8e7ad48d-f27d-4824-a413-63136234d9fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:13.462619 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-71476a39-c4a4-4269-a659-3630290632f6 req-8e7ad48d-f27d-4824-a413-63136234d9fc service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 1098 time: 0.3906441
May 27 09:28:13.494952 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:13.514048 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'port_id': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'mac_address': 'fa:16:3e:70:e3:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 396, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:28:13.562528 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7afa9dc1-75bc-4ff5-9970-ab0e5f40790e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.601386 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.611718 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6f63762a-6b83-4a5d-b40e-946e8b710e00 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:13.658133 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-27948280-98ff-41ea-a442-3287b825d758 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.663345 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:28:13.685527 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:13.695475 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.696893 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:28:13.697282 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-71476a39-c4a4-4269-a659-3630290632f6 req-7251799c-fb7c-4ae5-8800-3371820225d6 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2271380
May 27 09:28:13.703937 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:13.708089 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7afa9dc1-75bc-4ff5-9970-ab0e5f40790e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c29539a-ed6c-4334-8956-fb026cc2af7a,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:13.718136 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7afa9dc1-75bc-4ff5-9970-ab0e5f40790e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.719305 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-7afa9dc1-75bc-4ff5-9970-ab0e5f40790e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5c29539a-ed6c-4334-8956-fb026cc2af7a HTTP/1.1" status: 204  len: 168 time: 1.2236524
May 27 09:28:13.720619 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7afa9dc1-75bc-4ff5-9970-ab0e5f40790e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:13.721386 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb1eedf1-cd16-4dc0-84ec-a4b814678ecd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.742265 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-fb1eedf1-cd16-4dc0-84ec-a4b814678ecd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:13.744665 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-27948280-98ff-41ea-a442-3287b825d758 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.750352 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-fb1eedf1-cd16-4dc0-84ec-a4b814678ecd admin admin] Usage tracker for resource:security_group_rule and tenant:89377089bd0b4b5da762ba820ae49629 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:13.755025 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-fb1eedf1-cd16-4dc0-84ec-a4b814678ecd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:13.769853 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-fb1eedf1-cd16-4dc0-84ec-a4b814678ecd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:13.891623 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b775a342-d149-4bbc-81c0-8675f7fe9e0d req-8fe8b3f7-3808-42ca-a1d9-029ee78cc718 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:13.893552 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b775a342-d149-4bbc-81c0-8675f7fe9e0d req-8fe8b3f7-3808-42ca-a1d9-029ee78cc718 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 943 time: 0.1393008
May 27 09:28:13.951562 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-27948280-98ff-41ea-a442-3287b825d758 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.959221 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:13.980288 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b775a342-d149-4bbc-81c0-8675f7fe9e0d req-a2d5a879-b9d0-4a2d-8387-b9b1398f201f tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0757959
May 27 09:28:13.983293 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb1eedf1-cd16-4dc0-84ec-a4b814678ecd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.984577 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27948280-98ff-41ea-a442-3287b825d758 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5757a5ed-ba11-4d0d-b2de-c0703c647edc,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:13.992356 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fb1eedf1-cd16-4dc0-84ec-a4b814678ecd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:13.995657 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-27948280-98ff-41ea-a442-3287b825d758 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:14.016312 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-27948280-98ff-41ea-a442-3287b825d758 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:14.024103 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-27948280-98ff-41ea-a442-3287b825d758 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5757a5ed-ba11-4d0d-b2de-c0703c647edc HTTP/1.1" status: 204  len: 168 time: 0.5723429
May 27 09:28:14.024984 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-535aa110-44d2-4289-98b1-fc5ed516341a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:14.061676 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:14.066046 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.362s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:14.113897 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48252) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:14.115983 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-fb1eedf1-cd16-4dc0-84ec-a4b814678ecd admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=89377089bd0b4b5da762ba820ae49629&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7733636
May 27 09:28:14.116465 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb1eedf1-cd16-4dc0-84ec-a4b814678ecd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c39318f9-c34f-468a-a491-1cfcaad5a34c,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:14.123460 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-fb1eedf1-cd16-4dc0-84ec-a4b814678ecd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:14.147803 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:14.182477 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': 'e7cf8d12-6d8f-4d92-8664-d74ba281c8d2', 'network_id': 'ca288a2a-9fc5-474b-a3f5-732ddd5ede80', 'port_id': 'e7cf8d12-6d8f-4d92-8664-d74ba281c8d2', 'mac_address': 'fa:16:3e:57:9d:b3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 373, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2171d20e-0746-4ea0-9aa2-e8adfb7e51ac', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:28:14.277279 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-93344212-015a-46e7-b3bb-71d9a9bb6908 req-e79dbde3-af23-4084-bbef-1d783e57e128 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 210 time: 0.0868237
May 27 09:28:14.324889 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-25cff61d-4076-465d-af31-3ef9cc1532d2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:14.418625 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48260) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:14.454814 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e7b4702f-c83f-4179-b4bb-a540079de4b6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:14.480831 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:14.501618 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-25cff61d-4076-465d-af31-3ef9cc1532d2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:14.509102 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e7b4702f-c83f-4179-b4bb-a540079de4b6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:14.529085 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e7b4702f-c83f-4179-b4bb-a540079de4b6 admin admin] Usage tracker for resource:security_group_rule and tenant:905c5da4a0c5458da670a97113ab94ca is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:14.541905 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e7b4702f-c83f-4179-b4bb-a540079de4b6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:14.547154 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:28:14.557159 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e7b4702f-c83f-4179-b4bb-a540079de4b6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:14.608938 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:14.620083 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:14.625709 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:14.759829 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:14.764038 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:14.841533 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a458ab-af41-4132-89b4-d432f938bd4b req-d4a2dc34-2463-48a1-b2a7-ee25f370e73d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:14.855003 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-26a458ab-af41-4132-89b4-d432f938bd4b req-d4a2dc34-2463-48a1-b2a7-ee25f370e73d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 945 time: 0.4932961
May 27 09:28:14.933298 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:14.935667 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-25cff61d-4076-465d-af31-3ef9cc1532d2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:14.964606 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:14.982400 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['e7cf8d12-6d8f-4d92-8664-d74ba281c8d2'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:28:15.016303 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-26a458ab-af41-4132-89b4-d432f938bd4b req-3cf708b3-2222-45ca-a53d-ad26258cd0db tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1597507
May 27 09:28:15.029665 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25cff61d-4076-465d-af31-3ef9cc1532d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c39318f9-c34f-468a-a491-1cfcaad5a34c,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:15.040663 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-25cff61d-4076-465d-af31-3ef9cc1532d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:15.055511 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-669b414d-b3a6-4fd5-bb21-7809816e031a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:15.065904 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-669b414d-b3a6-4fd5-bb21-7809816e031a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 815 time: 0.4955153
May 27 09:28:15.070783 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-25cff61d-4076-465d-af31-3ef9cc1532d2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:15.088021 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-25cff61d-4076-465d-af31-3ef9cc1532d2 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c39318f9-c34f-468a-a491-1cfcaad5a34c HTTP/1.1" status: 204  len: 168 time: 0.9679937
May 27 09:28:15.104961 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Request body: {'port': {'device_id': 'e7d36019-4501-44b8-99c4-ff2d84aef03c', 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965', 'admin_state_up': True, 'tenant_id': '0daf73d9a2424c3e9ccbe74a9d2d94f5'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:15.154024 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ef20412-1906-4078-881b-19bdc5e68637 req-d81d7e7c-d0c2-4508-9b98-08bde7b7a320 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:15.157631 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['6c2d447f-c9da-40aa-a848-6fcbf0beecb3'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:28:15.160740 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0ef20412-1906-4078-881b-19bdc5e68637 req-d81d7e7c-d0c2-4508-9b98-08bde7b7a320 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.4608529
May 27 09:28:15.326959 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0ef20412-1906-4078-881b-19bdc5e68637 req-fe8595be-df71-4dd6-b82e-23e258b6255a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1534231
May 27 09:28:15.684830 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf5e2e0e-785e-4443-a35a-aaec72ec47f7 req-f504f3bc-14d2-40df-98d9-f79c804f9439 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:15.697442 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bf5e2e0e-785e-4443-a35a-aaec72ec47f7 req-f504f3bc-14d2-40df-98d9-f79c804f9439 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 944 time: 0.2800038
May 27 09:28:15.720571 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e7b4702f-c83f-4179-b4bb-a540079de4b6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:15.729728 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e7b4702f-c83f-4179-b4bb-a540079de4b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:15.810201 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-fb1eedf1-cd16-4dc0-84ec-a4b814678ecd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:15.822316 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-e7b4702f-c83f-4179-b4bb-a540079de4b6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=905c5da4a0c5458da670a97113ab94ca&name=default HTTP/1.1" status: 200  len: 2979 time: 1.4015641
May 27 09:28:15.827722 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:15.829137 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48308) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:15.855786 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69d5af20-af1f-40be-97f0-9966a9533c51 req-a27a9680-f923-4ff3-88d4-6c99807dc0e8 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 210 time: 0.1530015
May 27 09:28:15.858564 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:15.869295 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7b4702f-c83f-4179-b4bb-a540079de4b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93844fa8-3c06-4716-b859-f254226fed09,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:15.885380 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e7b4702f-c83f-4179-b4bb-a540079de4b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:15.893924 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Made reservation on behalf of 0daf73d9a2424c3e9ccbe74a9d2d94f5 for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:28:15.898588 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:15.990100 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bf5e2e0e-785e-4443-a35a-aaec72ec47f7 req-c1f70453-aeea-425c-87cb-7eab2babbd40 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2905676
May 27 09:28:16.053508 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48314) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:16.063815 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0ef55008-b603-4694-90a2-38f3ea076834 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:16.101390 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0ef55008-b603-4694-90a2-38f3ea076834 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:16.115301 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01fef9ea-0960-4195-b336-86deb4bffeb6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:16.176640 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0ef55008-b603-4694-90a2-38f3ea076834 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:16.184927 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5040358b-e50b-490d-8298-d34e1fff1ec0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:16.219682 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-01fef9ea-0960-4195-b336-86deb4bffeb6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:16.234718 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ef55008-b603-4694-90a2-38f3ea076834 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93844fa8-3c06-4716-b859-f254226fed09,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:16.242389 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0ef55008-b603-4694-90a2-38f3ea076834 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:16.243017 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-01fef9ea-0960-4195-b336-86deb4bffeb6 admin admin] Usage tracker for resource:security_group_rule and tenant:79449257c5084cdea2c21d60fd34b329 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:16.248513 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0ef55008-b603-4694-90a2-38f3ea076834 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:16.253956 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-0ef55008-b603-4694-90a2-38f3ea076834 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/93844fa8-3c06-4716-b859-f254226fed09 HTTP/1.1" status: 204  len: 168 time: 0.4046230
May 27 09:28:16.254246 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-01fef9ea-0960-4195-b336-86deb4bffeb6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:16.270102 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-01fef9ea-0960-4195-b336-86deb4bffeb6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:16.305192 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1199c31d-1f58-47d5-87f3-b0e2522ade23 req-d3fc5cc2-4719-486e-a265-8447bf3b9629 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:16.306861 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1199c31d-1f58-47d5-87f3-b0e2522ade23 req-d3fc5cc2-4719-486e-a265-8447bf3b9629 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 945 time: 0.1243923
May 27 09:28:16.314629 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Allocated IP 172.20.0.3 (7cbf7538-2626-435d-83dd-e10fb0c9e965/3d70d479-f390-4cd8-90ff-49a918615aa4/51dd2656-44f3-41cb-b4e3-38beccc875b4) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:28:16.412789 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1199c31d-1f58-47d5-87f3-b0e2522ade23 req-7ab83012-ff4e-4437-b637-f99e77c53a4d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0925524
May 27 09:28:16.713424 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01fef9ea-0960-4195-b336-86deb4bffeb6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:16.717169 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:16.724597 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01fef9ea-0960-4195-b336-86deb4bffeb6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:16.725592 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8716eb11-2d94-4e1e-8bf5-634510a38117 req-b25cb9ab-c978-42ff-a539-a168e3d9b4ec tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:16.726508 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8716eb11-2d94-4e1e-8bf5-634510a38117 req-b25cb9ab-c978-42ff-a539-a168e3d9b4ec tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1651628
May 27 09:28:16.739555 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4423bd47-1f60-4a7a-aadb-f04f85312a57 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:16.799537 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-01fef9ea-0960-4195-b336-86deb4bffeb6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=79449257c5084cdea2c21d60fd34b329&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7444830
May 27 09:28:16.802805 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01fef9ea-0960-4195-b336-86deb4bffeb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b17f9257-2ec6-4e08-b93f-aa193fb59914,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:16.818005 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48332) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:16.824605 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-01fef9ea-0960-4195-b336-86deb4bffeb6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:16.874879 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8716eb11-2d94-4e1e-8bf5-634510a38117 req-c42cb6f2-c772-4202-8107-5170f05d8b76 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1414502
May 27 09:28:16.913992 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:16.948098 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['2890994f-299e-4a4d-8e0a-945b6c38ecfe'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:28:16.993503 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-fccab185-35c0-4df6-ac46-3a94527100d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:17.103461 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48346) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:17.229614 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Pushing event updated for resources: {'Port': ['ID=51dd2656-44f3-41cb-b4e3-38beccc875b4,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:17.244073 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.260s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:17.248839 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Network 7cbf7538-2626-435d-83dd-e10fb0c9e965 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:28:17.251938 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:28:17.255083 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:28:17.255601 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-267b13a4-6eae-4687-994b-11779e7b8683 req-514fcfb0-6e7f-4269-bab6-f0fa8bb3fa68 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:17.264625 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-267b13a4-6eae-4687-994b-11779e7b8683 req-514fcfb0-6e7f-4269-bab6-f0fa8bb3fa68 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 931 time: 0.2247047
May 27 09:28:17.276625 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:28:17.291554 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:17.292996 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:17.360349 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1368e84b-6539-4767-bbce-f9f0778eb9ed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:17.383152 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-267b13a4-6eae-4687-994b-11779e7b8683 req-e17fbffa-f2dc-4a85-ada1-79a4e7f723eb tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1173441
May 27 09:28:17.438558 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 2.3555663
May 27 09:28:17.445001 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d652239a-f5b9-4a9a-a4b1-a33ccb4dcf90 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:17.462455 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Request body: {'port': {'device_id': 'e7d36019-4501-44b8-99c4-ff2d84aef03c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:17.512760 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d652239a-f5b9-4a9a-a4b1-a33ccb4dcf90 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:17.541445 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a585faf4-def7-4db7-b41d-ed8978693659 req-b2744380-7581-4bbb-850a-d2f41f1213ca tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:17.553652 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a585faf4-def7-4db7-b41d-ed8978693659 req-b2744380-7581-4bbb-850a-d2f41f1213ca tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.3729348
May 27 09:28:17.554739 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1368e84b-6539-4767-bbce-f9f0778eb9ed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:17.557911 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48360) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:17.578922 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-d652239a-f5b9-4a9a-a4b1-a33ccb4dcf90 admin admin] Usage tracker for resource:security_group_rule and tenant:ded31c4ee46b4058a115128f54ea75e6 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:17.590421 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-d652239a-f5b9-4a9a-a4b1-a33ccb4dcf90 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:17.663078 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:28:17.666241 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d652239a-f5b9-4a9a-a4b1-a33ccb4dcf90 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:17.681071 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:28:17.681682 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:17.748106 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1368e84b-6539-4767-bbce-f9f0778eb9ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:17.775054 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:17.798767 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-c9c39bdf-a643-4243-b669-d7dac536e927 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'floatingip': {'port_id': '5c6508e0-a5e3-49f0-adc0-fd87845be346'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:17.812538 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1368e84b-6539-4767-bbce-f9f0778eb9ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b17f9257-2ec6-4e08-b93f-aa193fb59914,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:17.816515 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:17.843191 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1368e84b-6539-4767-bbce-f9f0778eb9ed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:17.908277 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:17.935561 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1368e84b-6539-4767-bbce-f9f0778eb9ed admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:17.936772 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-1368e84b-6539-4767-bbce-f9f0778eb9ed admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b17f9257-2ec6-4e08-b93f-aa193fb59914 HTTP/1.1" status: 204  len: 168 time: 1.1158559
May 27 09:28:17.969152 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:17.987809 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c9c39bdf-a643-4243-b669-d7dac536e927 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:17.995314 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:18.002149 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:18.003067 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:28:18.134116 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-086f1751-f1fd-466f-8976-1e74cd1820e1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:18.300101 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:18.306408 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:18.339326 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:28:18.345730 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:28:18.346080 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:18.365851 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-111f28ae-e957-455b-b3db-135c3fcd9b4d req-2093ff8b-5ee0-424c-b637-7ecdc3042940 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:18.373423 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-111f28ae-e957-455b-b3db-135c3fcd9b4d req-2093ff8b-5ee0-424c-b637-7ecdc3042940 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 944 time: 0.8044066
May 27 09:28:18.504661 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cfe55db-d06c-422c-b226-b8efdf195bc0 req-778a0f4b-67ca-43bc-862a-7cb5fde7c61a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:18.512297 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3cfe55db-d06c-422c-b226-b8efdf195bc0 req-778a0f4b-67ca-43bc-862a-7cb5fde7c61a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 945 time: 0.6333275
May 27 09:28:18.605734 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d652239a-f5b9-4a9a-a4b1-a33ccb4dcf90 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:18.631520 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 51dd2656-44f3-41cb-b4e3-38beccc875b4 {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:28:18.639765 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-111f28ae-e957-455b-b3db-135c3fcd9b4d req-736b4998-0c8e-49fa-aef4-d72e63e92140 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2643983
May 27 09:28:18.659683 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:18.667516 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:18.728477 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Transition to ACTIVE for port object 51dd2656-44f3-41cb-b4e3-38beccc875b4 will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:28:18.743318 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:18.746021 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d652239a-f5b9-4a9a-a4b1-a33ccb4dcf90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:18.757086 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:18.776222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ad70686f-13ab-405f-ad70-f31daf750386 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:18.778402 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'code': 200}
May 27 09:28:18.791306 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:18.806137 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:18.808744 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:18.888324 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3cfe55db-d06c-422c-b226-b8efdf195bc0 req-679c2f96-4d20-4d96-aa41-87ae9fe882a4 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3747399
May 27 09:28:19.020262 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:19.043220 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.234s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:19.048923 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Pushing event updated for resources: {'Port': ['ID=51dd2656-44f3-41cb-b4e3-38beccc875b4,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:19.061315 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.288s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:19.061866 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d652239a-f5b9-4a9a-a4b1-a33ccb4dcf90 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=11046002-b3a7-44aa-b8d0-5d9dc93ef207,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:19.152157 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-d652239a-f5b9-4a9a-a4b1-a33ccb4dcf90 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.395s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:19.174576 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-d652239a-f5b9-4a9a-a4b1-a33ccb4dcf90 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ded31c4ee46b4058a115128f54ea75e6&name=default HTTP/1.1" status: 200  len: 2979 time: 2.0694191
May 27 09:28:19.186415 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48402) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:19.329071 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Attempting to bind port 51dd2656-44f3-41cb-b4e3-38beccc875b4 on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:28:19.329757 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Attempting to bind port 51dd2656-44f3-41cb-b4e3-38beccc875b4 by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:28:19.330547 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Attempting to bind port 51dd2656-44f3-41cb-b4e3-38beccc875b4 on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:28:19.354689 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Port 51dd2656-44f3-41cb-b4e3-38beccc875b4 on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:28:19.355015 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Attempting to bind port 51dd2656-44f3-41cb-b4e3-38beccc875b4 on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:28:19.384387 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 27, 57), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:28:19.385033 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Checking segment: {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:28:19.385589 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Bound using segment: {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:28:19.386229 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Bound port: 51dd2656-44f3-41cb-b4e3-38beccc875b4, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:28:19.386798 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:19.559822 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1d9bef4-dbca-4517-b048-f5fcda89a504 req-9c45f3c7-43e1-466a-b30a-69b6ea980824 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:19.563742 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f1d9bef4-dbca-4517-b048-f5fcda89a504 req-9c45f3c7-43e1-466a-b30a-69b6ea980824 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 1099 time: 0.3502016
May 27 09:28:19.589534 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-16569e50-a6c5-4457-bb3c-474405a2906e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:19.634756 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b6bf73-1290-4681-a140-0ca170e3a184 req-92cbd750-9038-4194-bab3-da7fd165b853 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:19.642201 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-61b6bf73-1290-4681-a140-0ca170e3a184 req-92cbd750-9038-4194-bab3-da7fd165b853 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 943 time: 0.5661631
May 27 09:28:19.657429 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f1d9bef4-dbca-4517-b048-f5fcda89a504 req-23b7bb46-b515-44a2-b047-142cc3df6437 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0855818
May 27 09:28:19.659590 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] For port 51dd2656-44f3-41cb-b4e3-38beccc875b4, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:28:19.677863 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] For port 51dd2656-44f3-41cb-b4e3-38beccc875b4, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=51dd2656-44f3-41cb-b4e3-38beccc875b4,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:28:19.692195 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:19.714635 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:19.805334 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48426) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:19.826136 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:19.827266 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:19.829397 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] 10.222.0.11 "PUT /v2.0/ports/51dd2656-44f3-41cb-b4e3-38beccc875b4 HTTP/1.1" status: 200  len: 1093 time: 2.3764150
May 27 09:28:19.830230 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e7d36019-4501-44b8-99c4-ff2d84aef03c', 'tag': '51dd2656-44f3-41cb-b4e3-38beccc875b4'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:19.838971 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-16569e50-a6c5-4457-bb3c-474405a2906e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:19.862761 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Pushing event updated for resources: {'Port': ['ID=51dd2656-44f3-41cb-b4e3-38beccc875b4,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:19.867655 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:19.917337 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.db.resource_extend [None req-c9c39bdf-a643-4243-b669-d7dac536e927 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] It took 0.27 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 27 09:28:20.012207 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-61b6bf73-1290-4681-a140-0ca170e3a184 req-79a4ccbc-2529-48d8-81e8-a2ab2bbb7b2f tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3687418
May 27 09:28:20.073511 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c9c39bdf-a643-4243-b669-d7dac536e927 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:20.081578 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c9c39bdf-a643-4243-b669-d7dac536e927 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:20.156506 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1364176785-network', 'tenant_id': '5d8ff0207b124e228a321e3108bca264'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:20.166020 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:20.177050 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Usage tracker for resource:network and tenant:5d8ff0207b124e228a321e3108bca264 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:20.183078 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:20.196054 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:20.215056 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Made reservation on behalf of 5d8ff0207b124e228a321e3108bca264 for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:28:20.218116 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:20.241080 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:20.246419 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d06ef6-809e-4c6b-b057-94359266ff4d req-481db342-5e8e-49b0-977f-c911f3175968 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:20.248980 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f9d06ef6-809e-4c6b-b057-94359266ff4d req-481db342-5e8e-49b0-977f-c911f3175968 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 946 time: 0.4756205
May 27 09:28:20.267107 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-c94e0a7f-a344-48c2-8ec2-bceae4088334 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:20.268716 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-c94e0a7f-a344-48c2-8ec2-bceae4088334 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 1096 time: 0.3625214
May 27 09:28:20.269839 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:20.273937 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-16569e50-a6c5-4457-bb3c-474405a2906e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:20.275551 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Usage tracker for resource:security_group_rule and tenant:5d8ff0207b124e228a321e3108bca264 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:20.279073 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:20.287994 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-992758bf-0a0c-4fb7-9285-4f66e0095180 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:20.290280 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:20.344049 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16569e50-a6c5-4457-bb3c-474405a2906e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=11046002-b3a7-44aa-b8d0-5d9dc93ef207,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:20.368822 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-16569e50-a6c5-4457-bb3c-474405a2906e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:20.397541 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-f094af15-7458-4d1f-be80-bf8c06ae93e2 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=51dd2656-44f3-41cb-b4e3-38beccc875b4 HTTP/1.1" status: 200  len: 217 time: 0.1124163
May 27 09:28:20.487950 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-16569e50-a6c5-4457-bb3c-474405a2906e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:20.490303 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-16569e50-a6c5-4457-bb3c-474405a2906e admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/11046002-b3a7-44aa-b8d0-5d9dc93ef207 HTTP/1.1" status: 204  len: 168 time: 1.3018508
May 27 09:28:20.554405 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f9d06ef6-809e-4c6b-b057-94359266ff4d req-50ebe097-e49c-4b11-85c7-032002496a9a tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2713428
May 27 09:28:20.555507 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-faaf6441-22be-408b-bb7f-ee7a320b3fe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:20.558105 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-faaf6441-22be-408b-bb7f-ee7a320b3fe0 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3d70d479-f390-4cd8-90ff-49a918615aa4 HTTP/1.1" status: 200  len: 855 time: 0.1498337
May 27 09:28:20.611108 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.l3_db [None req-c9c39bdf-a643-4243-b669-d7dac536e927 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Floating IP 5fc6be98-ec41-4ce6-951b-e30316534b68 associated. External IP: 172.27.1.118, port: 5c6508e0-a5e3-49f0-adc0-fd87845be346.
May 27 09:28:20.717274 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-0ead9dca-2183-455b-8f5d-e64d035fbdf4 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7cbf7538-2626-435d-83dd-e10fb0c9e965&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1493864
May 27 09:28:20.780059 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8164d612-dc97-4a3e-ab3b-0b55cc6032db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e7cf8d12-6d8f-4d92-8664-d74ba281c8d2'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:20.969070 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d669538-f2d6-494e-a88f-bbc759137c86 req-eb2dafea-7c86-4435-9d23-78e61ecd36af tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:20.980374 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1d669538-f2d6-494e-a88f-bbc759137c86 req-eb2dafea-7c86-4435-9d23-78e61ecd36af tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.8397782
May 27 09:28:21.111765 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e7d36019-4501-44b8-99c4-ff2d84aef03c', 'tag': '51dd2656-44f3-41cb-b4e3-38beccc875b4', 'status': 'completed', 'code': 200}
May 27 09:28:21.189445 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-0bfb61eb-505a-4b79-8a7a-8d5ef70a7e87 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4478304
May 27 09:28:21.239301 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:21.269679 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1d669538-f2d6-494e-a88f-bbc759137c86 req-13ed8568-ae22-4cf8-be61-780fc4c6699b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2883654
May 27 09:28:21.331251 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7a240df-a76e-4147-9c70-6deb7a995216 req-991a0d30-1062-4ffc-add0-77344a526605 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:21.334555 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a7a240df-a76e-4147-9c70-6deb7a995216 req-991a0d30-1062-4ffc-add0-77344a526605 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.2462578
May 27 09:28:21.344259 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:21.375712 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:21.410185 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8164d612-dc97-4a3e-ab3b-0b55cc6032db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e7cf8d12-6d8f-4d92-8664-d74ba281c8d2', 'code': 200}
May 27 09:28:21.440328 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] vlan segment allocate from pool success with {'vlan_id': 395, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:28:21.466303 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ff373bf-972c-40e3-bd47-5c1014c549df,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:21.475964 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:21.488952 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:21.489272 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Added segment 85dd26b8-fc5d-4c62-a263-46995c72f5bd of type vlan for network 282e7a70-510f-4fb1-bf23-c15fbeafc68f
May 27 09:28:21.503735 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f2a0f7ca-2c46-4629-8d2c-df57a9260117 req-e192a77a-f393-418b-9fda-801aa671d445 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2983961
May 27 09:28:21.553887 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:21.659697 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:21.688414 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:21.690071 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:21.728411 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:21.812333 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a7a240df-a76e-4147-9c70-6deb7a995216 req-cce9ba81-267d-4489-a109-ae72bd1dfd86 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1552608
May 27 09:28:21.830676 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9c39bdf-a643-4243-b669-d7dac536e927 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Router ad64253e-1ce7-4c03-90db-1073e41e8e5f has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:28:21.954893 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48492) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:22.018564 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c19b3bcb-b7de-4fb1-8c5a-3cad8795a322 req-e30ae95e-0d1c-4187-9426-7feae80b04ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:22.020387 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c19b3bcb-b7de-4fb1-8c5a-3cad8795a322 req-e30ae95e-0d1c-4187-9426-7feae80b04ad service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 1096 time: 0.4474118
May 27 09:28:22.032471 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 2.2134495
May 27 09:28:22.038434 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48500) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:22.074657 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Pushing event updated for resources: {'Network': ['ID=282e7a70-510f-4fb1-bf23-c15fbeafc68f,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:22.083000 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Request body: {'subnet': {'network_id': '282e7a70-510f-4fb1-bf23-c15fbeafc68f', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1364176785-subnet', 'tenant_id': '5d8ff0207b124e228a321e3108bca264', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:22.092130 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.364s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:22.092501 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 282e7a70-510f-4fb1-bf23-c15fbeafc68f details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:28:22.096822 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:22.166399 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Usage tracker for resource:subnet and tenant:5d8ff0207b124e228a321e3108bca264 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:22.171909 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:22.191719 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:22.240962 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684ea800-91f7-441e-9cd3-12f729dec9ad req-76c9dfc1-d056-46d8-9120-33576a11132f tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:22.251894 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3ca0d1-8781-4737-a430-e6a50446487e req-45cd9ee5-3155-4cab-abeb-8b7f57fe71a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:22.252952 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5e3ca0d1-8781-4737-a430-e6a50446487e req-45cd9ee5-3155-4cab-abeb-8b7f57fe71a1 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 1098 time: 0.4728436
May 27 09:28:22.253628 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Made reservation on behalf of 5d8ff0207b124e228a321e3108bca264 for: {'subnet': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:28:22.254061 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-684ea800-91f7-441e-9cd3-12f729dec9ad req-76c9dfc1-d056-46d8-9120-33576a11132f tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 943 time: 0.5908072
May 27 09:28:22.257609 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:22.391059 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-58041a73-a66a-4e5a-b580-ea037199e076 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.4705822
May 27 09:28:22.406408 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c19b3bcb-b7de-4fb1-8c5a-3cad8795a322 req-06c15591-c40e-465e-aae6-e890622aadd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:22.408092 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c19b3bcb-b7de-4fb1-8c5a-3cad8795a322 req-06c15591-c40e-465e-aae6-e890622aadd9 service neutron] 10.222.0.11 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 916 time: 0.3760781
May 27 09:28:22.516985 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c19b3bcb-b7de-4fb1-8c5a-3cad8795a322 req-0abe8c9e-63e6-41e7-afaf-9217f430e258 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=51dd2656-44f3-41cb-b4e3-38beccc875b4 HTTP/1.1" status: 200  len: 217 time: 0.0921094
May 27 09:28:22.528881 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5e3ca0d1-8781-4737-a430-e6a50446487e req-015661b0-c26f-40c0-8a0a-7d041e8ee9fb service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2509210
May 27 09:28:22.535690 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-13541cea-bf01-4631-9c3d-851713410c57 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:22.703027 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c19b3bcb-b7de-4fb1-8c5a-3cad8795a322 req-734e768f-65a2-4023-a2d7-7ea47070fea3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:22.706223 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c19b3bcb-b7de-4fb1-8c5a-3cad8795a322 req-734e768f-65a2-4023-a2d7-7ea47070fea3 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3d70d479-f390-4cd8-90ff-49a918615aa4 HTTP/1.1" status: 200  len: 855 time: 0.1753986
May 27 09:28:22.721834 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-13541cea-bf01-4631-9c3d-851713410c57 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:22.734239 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-13541cea-bf01-4631-9c3d-851713410c57 admin admin] Usage tracker for resource:security_group_rule and tenant:41aeb6b996f3400bb5b70b66dc006f0b is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:22.743200 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-684ea800-91f7-441e-9cd3-12f729dec9ad req-06dfa5b5-996a-4575-9c3b-225690203be0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4878457
May 27 09:28:22.748536 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-13541cea-bf01-4631-9c3d-851713410c57 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:22.762709 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a315c71b-b7e1-441c-8f4b-e721826cbb18 req-30863fb4-05f0-44c8-8b21-f6c6da29ce53 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:22.764442 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a315c71b-b7e1-441c-8f4b-e721826cbb18 req-30863fb4-05f0-44c8-8b21-f6c6da29ce53 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.11 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 946 time: 0.9259014
May 27 09:28:22.837554 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-13541cea-bf01-4631-9c3d-851713410c57 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:22.909504 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9c39bdf-a643-4243-b669-d7dac536e927 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:28:22.922751 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c9c39bdf-a643-4243-b669-d7dac536e927 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:22.943563 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94f71891-ce97-47ea-906a-11abb5fef3ca None None] Sync routers for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:28:22.976891 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94f71891-ce97-47ea-906a-11abb5fef3ca None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:28:22.977863 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-94f71891-ce97-47ea-906a-11abb5fef3ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd6faf0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:28:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:23.000918 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c19b3bcb-b7de-4fb1-8c5a-3cad8795a322 req-1ad9ffb0-4f71-4a72-8e49-4179e39c4329 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7cbf7538-2626-435d-83dd-e10fb0c9e965&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.2841289
May 27 09:28:23.128831 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd56185-4ed1-4952-91d3-8d86593e80c0 req-0831b271-7716-4e8d-be59-88bacf9f9430 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:23.130681 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ebd56185-4ed1-4952-91d3-8d86593e80c0 req-0831b271-7716-4e8d-be59-88bacf9f9430 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 946 time: 1.0303667
May 27 09:28:23.236782 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-0964a609-b90a-44c0-9abc-28452618a885 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:23.239449 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-0964a609-b90a-44c0-9abc-28452618a885 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 1098 time: 0.6567993
May 27 09:28:23.296492 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-c9c39bdf-a643-4243-b669-d7dac536e927 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "PUT /v2.0/floatingips/5fc6be98-ec41-4ce6-951b-e30316534b68 HTTP/1.1" status: 200  len: 991 time: 5.6391737
May 27 09:28:23.302649 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b428e51d-c310-481e-9c08-42415117a7a3', 'tag': '5c6508e0-a5e3-49f0-adc0-fd87845be346'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:23.337907 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ebd56185-4ed1-4952-91d3-8d86593e80c0 req-33ff5b2e-1abe-4ca8-ad5a-90022cc05f65 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1355162
May 27 09:28:23.381502 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-94f71891-ce97-47ea-906a-11abb5fef3ca None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:28:23.453400 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d3a999f-462a-4caa-bb88-d51e96767a1f req-a5e7cbda-d908-4c95-84f1-2be3e31a470a tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:23.469902 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2d3a999f-462a-4caa-bb88-d51e96767a1f req-a5e7cbda-d908-4c95-84f1-2be3e31a470a tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.4461970
May 27 09:28:23.489868 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-13541cea-bf01-4631-9c3d-851713410c57 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:23.537871 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-13541cea-bf01-4631-9c3d-851713410c57 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:23.556187 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c19b3bcb-b7de-4fb1-8c5a-3cad8795a322 req-4e6352a6-7690-44a8-b08d-cc4ed46f1d7a service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5386872
May 27 09:28:23.569680 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-c5a955f6-6833-426f-8909-b66aa8a17dd2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:23.599923 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-a315c71b-b7e1-441c-8f4b-e721826cbb18 req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Deleting port da4faf50-f101-4d33-a820-86240054a093 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:28:23.600479 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a315c71b-b7e1-441c-8f4b-e721826cbb18 req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:23.748300 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13541cea-bf01-4631-9c3d-851713410c57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5d01974-5bcd-4d4f-9edf-283fc83a8172,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:23.760707 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-13541cea-bf01-4631-9c3d-851713410c57 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=41aeb6b996f3400bb5b70b66dc006f0b&name=default HTTP/1.1" status: 200  len: 2979 time: 1.8038335
May 27 09:28:23.762153 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-13541cea-bf01-4631-9c3d-851713410c57 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:23.782081 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2d3a999f-462a-4caa-bb88-d51e96767a1f req-b5be02fe-cf9c-420a-9377-9ba220ae52dc tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3111207
May 27 09:28:23.782671 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48528) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:23.952165 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-78bb0b1d-f10b-44a6-b002-c554e248cb74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:23.953670 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-78bb0b1d-f10b-44a6-b002-c554e248cb74 service neutron] 10.222.0.11 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 916 time: 0.6804643
May 27 09:28:24.042659 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c19b3bcb-b7de-4fb1-8c5a-3cad8795a322 req-9db48966-02d6-44d4-beae-e3cf00ce6ff7 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4772911
May 27 09:28:24.100009 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-94f71891-ce97-47ea-906a-11abb5fef3ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd6faf0>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '5fc6be98-ec41-4ce6-951b-e30316534b68', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'floating_ip_address': '172.27.1.118', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'port_id': '5c6508e0-a5e3-49f0-adc0-fd87845be346', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 132, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'mac_address': 'fa:16:3e:ff:42:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b428e51d-c310-481e-9c08-42415117a7a3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:27:43Z', 'updated_at': '2021-05-27T09:28:19Z', 'revision_number': 1, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:24.105332 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94f71891-ce97-47ea-906a-11abb5fef3ca None None] Checking router: ad64253e-1ce7-4c03-90db-1073e41e8e5f for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:28:24.116394 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94f71891-ce97-47ea-906a-11abb5fef3ca None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:28:24.117048 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-94f71891-ce97-47ea-906a-11abb5fef3ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd6faf0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:28:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:24.236295 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-142ae7fe-599a-4888-8d8d-69aa288f67d1 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2890994f-299e-4a4d-8e0a-945b6c38ecfe HTTP/1.1" status: 200  len: 217 time: 0.1921155
May 27 09:28:24.259893 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-a315c71b-b7e1-441c-8f4b-e721826cbb18 req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] For port da4faf50-f101-4d33-a820-86240054a093, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=da4faf50-f101-4d33-a820-86240054a093,segment=NetworkSegment(519332c4-0201-4d92-9424-ec0b1d1407e4),segment_id=519332c4-0201-4d92-9424-ec0b1d1407e4)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:24.260409 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a315c71b-b7e1-441c-8f4b-e721826cbb18 req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:24.268536 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cb8c49e0-8b0a-4040-bd5b-2be43961b721 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:24.360904 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-8fba0bde-bf0e-49a8-9486-583bbf441fae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:24.363213 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-8fba0bde-bf0e-49a8-9486-583bbf441fae service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3d70d479-f390-4cd8-90ff-49a918615aa4 HTTP/1.1" status: 200  len: 855 time: 0.1194272
May 27 09:28:24.394420 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b428e51d-c310-481e-9c08-42415117a7a3', 'tag': '5c6508e0-a5e3-49f0-adc0-fd87845be346', 'status': 'completed', 'code': 200}
May 27 09:28:24.419096 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-94f71891-ce97-47ea-906a-11abb5fef3ca None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:28:24.487631 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-a315c71b-b7e1-441c-8f4b-e721826cbb18 req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Calling delete_port for da4faf50-f101-4d33-a820-86240054a093 owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:28:24.516379 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-380720e4-ac63-472f-8171-29e2fbe58dc8 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7cbf7538-2626-435d-83dd-e10fb0c9e965&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1000197
May 27 09:28:24.519338 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b693ddf5-4e45-4e8f-bfd4-fca81fd7fc93 req-02df1079-9dc7-45fe-954a-2220bc2918b6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:24.527711 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b693ddf5-4e45-4e8f-bfd4-fca81fd7fc93 req-02df1079-9dc7-45fe-954a-2220bc2918b6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.7411339
May 27 09:28:24.532709 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cb8c49e0-8b0a-4040-bd5b-2be43961b721 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:24.695577 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cfd0998-d5d5-42ee-923e-dc169315b3dd req-a13f2c0f-01c7-4732-bb7d-ee69a7c26e3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:24.695577 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-9cfd0998-d5d5-42ee-923e-dc169315b3dd req-a13f2c0f-01c7-4732-bb7d-ee69a7c26e3e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 1098 time: 0.3240485
May 27 09:28:24.752020 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b693ddf5-4e45-4e8f-bfd4-fca81fd7fc93 req-bbf18147-93af-4ba0-bba2-83637cf290d7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2232888
May 27 09:28:24.869964 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cb8c49e0-8b0a-4040-bd5b-2be43961b721 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:24.881230 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-562077f1-fc2e-43a8-9727-25daecb39e0c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:24.939075 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-2c001c40-1559-44a9-a467-a9a7ae77a6d5 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4096551
May 27 09:28:24.960220 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb8c49e0-8b0a-4040-bd5b-2be43961b721 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5d01974-5bcd-4d4f-9edf-283fc83a8172,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:24.962640 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-cb8c49e0-8b0a-4040-bd5b-2be43961b721 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:24.981962 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810'] for subnet, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:24.987904 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fe8ba62-984d-4ec4-ba1e-d9487b35e630 req-f194f730-962c-4d0e-ba5d-dba3a887631b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:24.996856 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6fe8ba62-984d-4ec4-ba1e-d9487b35e630 req-f194f730-962c-4d0e-ba5d-dba3a887631b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 943 time: 0.3528118
May 27 09:28:25.014237 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:25.040460 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-cb8c49e0-8b0a-4040-bd5b-2be43961b721 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:25.041879 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-cb8c49e0-8b0a-4040-bd5b-2be43961b721 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e5d01974-5bcd-4d4f-9edf-283fc83a8172 HTTP/1.1" status: 204  len: 168 time: 1.2333972
May 27 09:28:25.072210 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a315c71b-b7e1-441c-8f4b-e721826cbb18 req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:25.090192 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:25.110017 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-94f71891-ce97-47ea-906a-11abb5fef3ca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd6faf0>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '5fc6be98-ec41-4ce6-951b-e30316534b68', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'floating_ip_address': '172.27.1.118', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'port_id': '5c6508e0-a5e3-49f0-adc0-fd87845be346', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 132, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'mac_address': 'fa:16:3e:ff:42:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b428e51d-c310-481e-9c08-42415117a7a3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:27:43Z', 'updated_at': '2021-05-27T09:28:19Z', 'revision_number': 1, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:25.116983 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94f71891-ce97-47ea-906a-11abb5fef3ca None None] The sync data for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi is: [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '5fc6be98-ec41-4ce6-951b-e30316534b68', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'floating_ip_address': '172.27.1.118', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'port_id': '5c6508e0-a5e3-49f0-adc0-fd87845be346', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 132, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'mac_address': 'fa:16:3e:ff:42:0d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b428e51d-c310-481e-9c08-42415117a7a3', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:27:43Z', 'updated_at': '2021-05-27T09:28:19Z', 'revision_number': 1, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:28:25.140769 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6fe8ba62-984d-4ec4-ba1e-d9487b35e630 req-a0f82ef3-1589-44c0-a1ae-1639e34783f0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1427372
May 27 09:28:25.154990 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cfd0998-d5d5-42ee-923e-dc169315b3dd req-c0f9df11-2610-4740-9007-55f47504220e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:25.162095 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-9cfd0998-d5d5-42ee-923e-dc169315b3dd req-c0f9df11-2610-4740-9007-55f47504220e service neutron] 10.222.0.11 "GET /v2.0/networks?id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 200  len: 912 time: 0.4610617
May 27 09:28:25.170618 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Pushing event deleted for resources: {'Port': ['ID=da4faf50-f101-4d33-a820-86240054a093,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:25.178961 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:25.248087 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 51dd2656-44f3-41cb-b4e3-38beccc875b4 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:28:25.254371 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device da4faf50-f101-4d33-a820-86240054a093 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:28:25.330151 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: da4faf50-f101-4d33-a820-86240054a093 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:28:25.330514 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device da4faf50-f101-4d33-a820-86240054a093 not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:28:25.360005 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-a315c71b-b7e1-441c-8f4b-e721826cbb18 req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] No DVR routers for this DVR port da4faf50-f101-4d33-a820-86240054a093 on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:28:25.376424 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abb4832-362d-4515-9a6a-236bc841f88a req-e72096a0-14b2-4fe0-a3a0-40d761ff96bf tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:25.381328 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d97ae7ef-a379-429e-a964-20071e6f1131,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:25.383159 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-9abb4832-362d-4515-9a6a-236bc841f88a req-e72096a0-14b2-4fe0-a3a0-40d761ff96bf tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Synchronizing usage tracker for tenant:1e809ec6b9624e98a228033a8d2c59f1 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:28:25.399789 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.385s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:25.535483 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8151ecea-e683-43f7-9558-cdc1714efc4f None None] New status for floating IP 5fc6be98-ec41-4ce6-951b-e30316534b68: ACTIVE {{(pid=91822) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:28:25.580516 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Checking segment: {'id': '85dd26b8-fc5d-4c62-a263-46995c72f5bd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 395, 'network_id': '282e7a70-510f-4fb1-bf23-c15fbeafc68f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:28:25.580895 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Network hostable DHCP agents. Network: 282e7a70-510f-4fb1-bf23-c15fbeafc68f, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91820) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:28:25.629060 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-9cfd0998-d5d5-42ee-923e-dc169315b3dd req-d637daac-0c5c-41eb-838e-94141011fcd8 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5c6508e0-a5e3-49f0-adc0-fd87845be346 HTTP/1.1" status: 200  len: 999 time: 0.4262533
May 27 09:28:25.634445 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-587307ef-9d39-4ecb-b5a8-8b2a4b3b2685 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6815338
May 27 09:28:25.682281 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a315c71b-b7e1-441c-8f4b-e721826cbb18 req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:25.685983 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a315c71b-b7e1-441c-8f4b-e721826cbb18 req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.11 "DELETE /v2.0/ports/da4faf50-f101-4d33-a820-86240054a093 HTTP/1.1" status: 204  len: 173 time: 2.9112766
May 27 09:28:25.692924 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-9abb4832-362d-4515-9a6a-236bc841f88a req-e72096a0-14b2-4fe0-a3a0-40d761ff96bf tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Unset dirty status for tenant:1e809ec6b9624e98a228033a8d2c59f1 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:28:25.697434 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Network 282e7a70-510f-4fb1-bf23-c15fbeafc68f is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91820) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:28:25.705931 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9abb4832-362d-4515-9a6a-236bc841f88a req-e72096a0-14b2-4fe0-a3a0-40d761ff96bf tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 946 time: 0.8106558
May 27 09:28:25.750111 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 282e7a70-510f-4fb1-bf23-c15fbeafc68f) {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:28:25.785864 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:25.788237 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:25.798971 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48554) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:25.856337 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cfd0998-d5d5-42ee-923e-dc169315b3dd req-fac7fbda-77a5-4e7a-abae-4f41f1f17836 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:25.858911 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-9cfd0998-d5d5-42ee-923e-dc169315b3dd req-fac7fbda-77a5-4e7a-abae-4f41f1f17836 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b2c650ce-3329-4545-aaac-c69109472b2b HTTP/1.1" status: 200  len: 850 time: 0.2172172
May 27 09:28:25.866345 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 3.8038595
May 27 09:28:25.876859 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9abb4832-362d-4515-9a6a-236bc841f88a req-487efc8a-4a92-4b30-831a-cd470d9c82bb tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/security-groups?id=e8bf65a1-fc64-4453-8162-f7e810f7e312&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1695862
May 27 09:28:25.879835 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9e9500c3-d5e7-4969-afc8-32b76f4c8935 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:25.883326 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e99c5fce-29de-4ed8-86f6-bfa235291bad None None] Network 282e7a70-510f-4fb1-bf23-c15fbeafc68f requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:28:25.913906 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b45f18f0-9b3b-4b04-9ff0-ca67ab4809e9 req-702e8345-41b7-4bf8-aad5-9e944b807eb8 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:25.917525 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b45f18f0-9b3b-4b04-9ff0-ca67ab4809e9 req-702e8345-41b7-4bf8-aad5-9e944b807eb8 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.5606575
May 27 09:28:25.929447 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48564) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:25.933353 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-9e9500c3-d5e7-4969-afc8-32b76f4c8935 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:25.941867 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-a6d23bf9-953a-477e-9adb-60f390c06b13 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'floatingip': {'port_id': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:26.026377 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-9e9500c3-d5e7-4969-afc8-32b76f4c8935 admin admin] Usage tracker for resource:security_group_rule and tenant:0e57283f54ce42219adccf86fc27ee7f is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:26.183102 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cfd0998-d5d5-42ee-923e-dc169315b3dd req-b5156a70-ea17-4878-9ce5-07698611c337 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:26.185761 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-9cfd0998-d5d5-42ee-923e-dc169315b3dd req-b5156a70-ea17-4878-9ce5-07698611c337 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3178241
May 27 09:28:26.192010 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-9e9500c3-d5e7-4969-afc8-32b76f4c8935 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:26.229931 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-9e9500c3-d5e7-4969-afc8-32b76f4c8935 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:26.236399 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 51dd2656-44f3-41cb-b4e3-38beccc875b4, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=51dd2656-44f3-41cb-b4e3-38beccc875b4,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:26.247890 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a6d23bf9-953a-477e-9adb-60f390c06b13 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:26.285306 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '51dd2656-44f3-41cb-b4e3-38beccc875b4', 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965', 'port_id': '51dd2656-44f3-41cb-b4e3-38beccc875b4', 'mac_address': 'fa:16:3e:bc:52:f0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 386, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3d70d479-f390-4cd8-90ff-49a918615aa4', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:28:26.402832 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'cf0e942c-e831-44eb-9aad-239ffadc6bbe', 'name': 'network-vif-deleted', 'tag': 'da4faf50-f101-4d33-a820-86240054a093'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:26.518395 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:26.577728 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-9cfd0998-d5d5-42ee-923e-dc169315b3dd req-c792426b-8799-4132-93aa-ef2dea9abcd0 service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3788128
May 27 09:28:26.599839 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 51dd2656-44f3-41cb-b4e3-38beccc875b4 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:28:26.653777 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 51dd2656-44f3-41cb-b4e3-38beccc875b4, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=51dd2656-44f3-41cb-b4e3-38beccc875b4,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:26.686275 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:26.691843 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:26.695257 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-adfaba07-d126-4643-ba33-7aead246af3c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:26.750931 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e36860f-28d5-40e2-84f8-4d817ccf71d9 req-ca9a8a3a-0a24-46ca-afe4-cda30bae3628 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:26.760052 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1e36860f-28d5-40e2-84f8-4d817ccf71d9 req-ca9a8a3a-0a24-46ca-afe4-cda30bae3628 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.7220395
May 27 09:28:26.900879 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=51dd2656-44f3-41cb-b4e3-38beccc875b4,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:26.902480 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-9cfd0998-d5d5-42ee-923e-dc169315b3dd req-04dcd9ae-daa5-4998-a712-8e5563225a99 service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3168483
May 27 09:28:26.903898 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2846511-d0b0-47f4-8b57-ebadccabbe92 req-52649831-0a7b-40a3-8248-f580deebbc2e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:26.904391 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:26.907138 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1f23dccc-65a1-46f4-ae73-0e295c5e302e None None] Network 282e7a70-510f-4fb1-bf23-c15fbeafc68f requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:28:26.912325 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f2846511-d0b0-47f4-8b57-ebadccabbe92 req-52649831-0a7b-40a3-8248-f580deebbc2e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 943 time: 0.3970408
May 27 09:28:26.979922 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9e9500c3-d5e7-4969-afc8-32b76f4c8935 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.003562 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9e9500c3-d5e7-4969-afc8-32b76f4c8935 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.022509 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1e36860f-28d5-40e2-84f8-4d817ccf71d9 req-3bf23839-a308-43d9-a7da-2a32cbf19df6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2612855
May 27 09:28:27.029658 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-add60190-b6e6-49c6-94ee-f34edf1431bb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:27.036601 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['51dd2656-44f3-41cb-b4e3-38beccc875b4'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:28:27.101983 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48592) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:27.109097 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-54682905-network', 'tenant_id': '1973c8a9071149949e1ee94ec5f8e419'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:27.117396 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:27.124060 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f2846511-d0b0-47f4-8b57-ebadccabbe92 req-46984e54-c752-4528-a069-78b7afe782b4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2107325
May 27 09:28:27.130511 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Usage tracker for resource:network and tenant:1973c8a9071149949e1ee94ec5f8e419 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:27.141158 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:27.149684 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:27.168310 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Made reservation on behalf of 1973c8a9071149949e1ee94ec5f8e419 for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:28:27.172313 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.203399 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'cf0e942c-e831-44eb-9aad-239ffadc6bbe', 'name': 'network-vif-deleted', 'tag': 'da4faf50-f101-4d33-a820-86240054a093', 'status': 'completed', 'code': 200}
May 27 09:28:27.224049 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.249101 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:27.256201 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Usage tracker for resource:security_group_rule and tenant:1973c8a9071149949e1ee94ec5f8e419 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:27.261708 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:27.265264 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-9e9500c3-d5e7-4969-afc8-32b76f4c8935 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=0e57283f54ce42219adccf86fc27ee7f&name=default HTTP/1.1" status: 200  len: 2979 time: 1.4564993
May 27 09:28:27.266609 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48598) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:27.268993 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e9500c3-d5e7-4969-afc8-32b76f4c8935 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2d584396-d379-45c8-8fd3-7a9764dc5b61,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:27.276779 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:27.292486 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-9e9500c3-d5e7-4969-afc8-32b76f4c8935 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.263s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:27.500759 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.509463 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.514226 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8e87b090-5b2a-46c5-93db-11a76f97564d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:27.542407 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b404eff5-4279-425d-b177-403a8d85ba4e req-b0a8257a-602a-473f-869f-b7429c40bf1c tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] 10.222.0.30 "GET /v2.0/ports?device_id=cf0e942c-e831-44eb-9aad-239ffadc6bbe HTTP/1.1" status: 200  len: 210 time: 0.0826242
May 27 09:28:27.546754 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6902932b-3a82-484f-928b-6db6b40ff79a,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:27.551471 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:27.564607 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] vlan segment allocate from pool success with {'vlan_id': 394, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:28:27.566618 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9bcb496-54ac-46d3-a04f-ca78f962adca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.601977 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.603439 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Added segment d1235ce8-44b0-4268-ab6a-fd54c53df214 of type vlan for network 0720c9f4-4d57-4c27-90c2-5ab1f11c1478
May 27 09:28:27.609751 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9bcb496-54ac-46d3-a04f-ca78f962adca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.657682 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.805236 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.809716 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:27.810815 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.820355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:27.898827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9bcb496-54ac-46d3-a04f-ca78f962adca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.907073 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a6d23bf9-953a-477e-9adb-60f390c06b13 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.907924 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:27.923896 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a6d23bf9-953a-477e-9adb-60f390c06b13 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:27.972615 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6205582e-c953-469e-94d3-342c86628662 req-1683418b-210b-4dd9-a72d-ee4f89ead772 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:27.975361 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6205582e-c953-469e-94d3-342c86628662 req-1683418b-210b-4dd9-a72d-ee4f89ead772 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 1098 time: 0.2988000
May 27 09:28:27.983866 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9bcb496-54ac-46d3-a04f-ca78f962adca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d584396-d379-45c8-8fd3-7a9764dc5b61,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:28.003193 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a9bcb496-54ac-46d3-a04f-ca78f962adca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:28.110453 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a9bcb496-54ac-46d3-a04f-ca78f962adca admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:28.112124 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-a9bcb496-54ac-46d3-a04f-ca78f962adca admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/2d584396-d379-45c8-8fd3-7a9764dc5b61 HTTP/1.1" status: 204  len: 168 time: 0.8436801
May 27 09:28:28.136394 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 880 time: 1.0320363
May 27 09:28:28.137865 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48610) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:28.163666 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Pushing event updated for resources: {'Network': ['ID=0720c9f4-4d57-4c27-90c2-5ab1f11c1478,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:28.179724 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 0720c9f4-4d57-4c27-90c2-5ab1f11c1478 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:28:28.191253 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Request body: {'subnet': {'network_id': '0720c9f4-4d57-4c27-90c2-5ab1f11c1478', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-54682905-subnet', 'tenant_id': '1973c8a9071149949e1ee94ec5f8e419', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:28.193532 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b2ba34-2585-473e-8874-93d1afbd9302 req-141f0331-8d1d-4b2d-8840-5c850ab9ce4d tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:28.200879 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f1b2ba34-2585-473e-8874-93d1afbd9302 req-141f0331-8d1d-4b2d-8840-5c850ab9ce4d tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.4109397
May 27 09:28:28.216059 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.395s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:28.234026 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:28.256962 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Usage tracker for resource:subnet and tenant:1973c8a9071149949e1ee94ec5f8e419 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:28.282471 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:28.298078 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f1b2ba34-2585-473e-8874-93d1afbd9302 req-09b5853d-4c4e-4d36-b3b8-32ef9f5410ac tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0961392
May 27 09:28:28.299638 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.l3_db [None req-a6d23bf9-953a-477e-9adb-60f390c06b13 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Floating IP 1e925ef8-9c21-49c4-9220-1dc6bad97177 associated. External IP: 172.27.1.79, port: 6c2d447f-c9da-40aa-a848-6fcbf0beecb3.
May 27 09:28:28.349133 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:28.446398 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6205582e-c953-469e-94d3-342c86628662 req-95f0f118-e509-4ebd-8ee2-abbd4fd0913b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:28.449307 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6205582e-c953-469e-94d3-342c86628662 req-95f0f118-e509-4ebd-8ee2-abbd4fd0913b service neutron] 10.222.0.11 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 920 time: 0.4635477
May 27 09:28:28.450377 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Made reservation on behalf of 1973c8a9071149949e1ee94ec5f8e419 for: {'subnet': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:28:28.454316 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:28.478293 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48618) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:28.718858 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6205582e-c953-469e-94d3-342c86628662 req-95c46919-7040-4d6b-babb-efffa05b8bb1 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 HTTP/1.1" status: 200  len: 217 time: 0.2390451
May 27 09:28:28.913523 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b1706588-ec70-4b3a-881d-2e72944001d5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:28.935411 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6205582e-c953-469e-94d3-342c86628662 req-c1b58a51-eba7-446b-8c98-3bd151b9cbf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:28.937624 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6205582e-c953-469e-94d3-342c86628662 req-c1b58a51-eba7-446b-8c98-3bd151b9cbf0 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac HTTP/1.1" status: 200  len: 859 time: 0.2085652
May 27 09:28:28.948701 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-b1706588-ec70-4b3a-881d-2e72944001d5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:28.954184 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-b1706588-ec70-4b3a-881d-2e72944001d5 admin admin] Usage tracker for resource:security_group_rule and tenant:a361172be27d4b0597378c31dc40a591 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:28.958618 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-b1706588-ec70-4b3a-881d-2e72944001d5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:28.968912 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-b1706588-ec70-4b3a-881d-2e72944001d5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:29.041500 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6205582e-c953-469e-94d3-342c86628662 req-da2fe660-ed38-453f-b9f0-d372b6b48131 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0682919
May 27 09:28:29.071789 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebf3c905-7d1e-49e4-8401-6b75b66d14be req-e483690f-a28f-4c07-93b6-88d0c2047e2b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:29.074543 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ebf3c905-7d1e-49e4-8401-6b75b66d14be req-e483690f-a28f-4c07-93b6-88d0c2047e2b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 944 time: 0.6106684
May 27 09:28:29.264365 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 51dd2656-44f3-41cb-b4e3-38beccc875b4 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:28:29.381965 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6205582e-c953-469e-94d3-342c86628662 req-5426fc21-a32e-48a6-bf21-38341d825662 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2955606
May 27 09:28:29.450235 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 51dd2656-44f3-41cb-b4e3-38beccc875b4 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:28:29.468477 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 51dd2656-44f3-41cb-b4e3-38beccc875b4 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:28:29.468477 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:29.476557 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a6d23bf9-953a-477e-9adb-60f390c06b13 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:28:29.501022 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ebf3c905-7d1e-49e4-8401-6b75b66d14be req-6775a243-243f-446b-bf00-9587981f0990 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.4050367
May 27 09:28:29.715277 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b1706588-ec70-4b3a-881d-2e72944001d5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:29.755824 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:29.780679 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b1706588-ec70-4b3a-881d-2e72944001d5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:29.791317 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e7d36019-4501-44b8-99c4-ff2d84aef03c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '51dd2656-44f3-41cb-b4e3-38beccc875b4'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:29.804358 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 51dd2656-44f3-41cb-b4e3-38beccc875b4, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=51dd2656-44f3-41cb-b4e3-38beccc875b4,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:29.809176 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:29.813006 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:29.815680 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:29.883625 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-b1706588-ec70-4b3a-881d-2e72944001d5 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a361172be27d4b0597378c31dc40a591&name=default HTTP/1.1" status: 200  len: 2979 time: 1.3931911
May 27 09:28:29.886053 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48658) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:29.902306 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1706588-ec70-4b3a-881d-2e72944001d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=440a1142-6542-4c43-b98f-7296f34bb97c,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:29.906143 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b1706588-ec70-4b3a-881d-2e72944001d5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:29.948364 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=51dd2656-44f3-41cb-b4e3-38beccc875b4,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:29.959327 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6205582e-c953-469e-94d3-342c86628662 req-ae097ca4-c665-4534-86ea-663812919ae7 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5577865
May 27 09:28:29.974602 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:29.978511 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e7d36019-4501-44b8-99c4-ff2d84aef03c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '51dd2656-44f3-41cb-b4e3-38beccc875b4', 'code': 200}
May 27 09:28:30.120078 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f83d2088-c82a-488b-95a3-bfc9e385f71b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:30.184487 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a6d23bf9-953a-477e-9adb-60f390c06b13 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:28:30.193676 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a6d23bf9-953a-477e-9adb-60f390c06b13 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:30.200822 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76b3e985-136b-42f0-ba2b-7de755022a4f None None] Sync routers for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:28:30.216211 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76b3e985-136b-42f0-ba2b-7de755022a4f None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:28:30.218548 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-76b3e985-136b-42f0-ba2b-7de755022a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed9847c0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:28:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:30.225222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f83d2088-c82a-488b-95a3-bfc9e385f71b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:30.279267 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-a6d23bf9-953a-477e-9adb-60f390c06b13 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "PUT /v2.0/floatingips/1e925ef8-9c21-49c4-9220-1dc6bad97177 HTTP/1.1" status: 200  len: 991 time: 4.3444133
May 27 09:28:30.281362 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:30.304835 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eefc326b-2c97-492a-ab01-edcb1601f752 req-61bacfd8-925e-40c8-9499-94b99810e00d tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:30.314108 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-eefc326b-2c97-492a-ab01-edcb1601f752 req-61bacfd8-925e-40c8-9499-94b99810e00d tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2632191
May 27 09:28:30.416455 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-eefc326b-2c97-492a-ab01-edcb1601f752 req-f3b1c1b8-b26c-43ed-8115-2ecca233bdf8 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0997930
May 27 09:28:30.456939 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f83d2088-c82a-488b-95a3-bfc9e385f71b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:30.468597 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:30.495591 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f83d2088-c82a-488b-95a3-bfc9e385f71b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=440a1142-6542-4c43-b98f-7296f34bb97c,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:30.503666 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f83d2088-c82a-488b-95a3-bfc9e385f71b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:30.636468 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'status': 'completed', 'code': 200}
May 27 09:28:30.639809 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f83d2088-c82a-488b-95a3-bfc9e385f71b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:30.654028 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-f83d2088-c82a-488b-95a3-bfc9e385f71b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/440a1142-6542-4c43-b98f-7296f34bb97c HTTP/1.1" status: 204  len: 168 time: 0.7633119
May 27 09:28:30.654428 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-76b3e985-136b-42f0-ba2b-7de755022a4f None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:28:30.670891 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810'] for subnet, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:30.681571 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-eccb3ce0-8e47-49f1-abfb-b87f002226e2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:30.868078 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13fe0a07-b5ea-414b-a0eb-71f6d494875d req-8ff25d2a-5484-4ce0-b443-562d1beec477 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:30.871824 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-13fe0a07-b5ea-414b-a0eb-71f6d494875d req-8ff25d2a-5484-4ce0-b443-562d1beec477 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 1099 time: 0.1942728
May 27 09:28:30.899813 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa2977b-8073-4060-8c89-5aac29bd509d req-f9977dc5-2c21-459b-a3e8-c17f59c10de1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:30.902951 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cfa2977b-8073-4060-8c89-5aac29bd509d req-f9977dc5-2c21-459b-a3e8-c17f59c10de1 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 1098 time: 0.4049428
May 27 09:28:30.966009 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a73cdc30-5c64-48b7-be2c-1b2ea92c9bfd,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:30.977549 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:31.010996 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Checking segment: {'id': 'd1235ce8-44b0-4268-ab6a-fd54c53df214', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 394, 'network_id': '0720c9f4-4d57-4c27-90c2-5ab1f11c1478'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:28:31.012084 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Network hostable DHCP agents. Network: 0720c9f4-4d57-4c27-90c2-5ab1f11c1478, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91820) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:28:31.035181 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cfa2977b-8073-4060-8c89-5aac29bd509d req-59e37fdd-1d43-409b-82e4-60b5fbff16dc service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1062207
May 27 09:28:31.060262 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Network 0720c9f4-4d57-4c27-90c2-5ab1f11c1478 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91820) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:28:31.085452 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 0720c9f4-4d57-4c27-90c2-5ab1f11c1478) {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:28:31.100089 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa8204dd-adea-4d25-9bf9-8a1c650aaae3 None None] Network 0720c9f4-4d57-4c27-90c2-5ab1f11c1478 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:28:31.108597 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:31.109899 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:31.160800 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 844 time: 2.9897645
May 27 09:28:31.294174 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48692) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:31.343631 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bdf0d60-ad46-4635-853e-992937577376 req-3939821e-f3b6-475c-8fcc-9656af45bfb8 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:31.365177 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3bdf0d60-ad46-4635-853e-992937577376 req-3939821e-f3b6-475c-8fcc-9656af45bfb8 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 945 time: 0.5014639
May 27 09:28:31.430863 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13fe0a07-b5ea-414b-a0eb-71f6d494875d req-f04c483b-7dfb-40c2-8f35-9edd2d62f706 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:31.433467 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-13fe0a07-b5ea-414b-a0eb-71f6d494875d req-f04c483b-7dfb-40c2-8f35-9edd2d62f706 service neutron] 10.222.0.11 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 917 time: 0.4883928
May 27 09:28:31.515576 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48702) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:31.553720 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e8341e7-11b7-42e0-b5fb-966f712fd765 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:31.596368 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-8e8341e7-11b7-42e0-b5fb-966f712fd765 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:31.596652 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-76b3e985-136b-42f0-ba2b-7de755022a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed9847c0>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '1e925ef8-9c21-49c4-9220-1dc6bad97177', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'floating_ip_address': '172.27.1.79', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'port_id': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 137, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'mac_address': 'fa:16:3e:70:e3:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:27:49Z', 'updated_at': '2021-05-27T09:28:27Z', 'revision_number': 1, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:31.603331 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-8e8341e7-11b7-42e0-b5fb-966f712fd765 admin admin] Usage tracker for resource:security_group_rule and tenant:0f59a4cf3fbd48c7af4f77d74f68500d is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:31.608482 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-8e8341e7-11b7-42e0-b5fb-966f712fd765 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:31.613714 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76b3e985-136b-42f0-ba2b-7de755022a4f None None] Checking router: a7747f73-c1a4-4a6c-8c93-cf80d93a5583 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:28:31.630704 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-8e8341e7-11b7-42e0-b5fb-966f712fd765 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:31.637833 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76b3e985-136b-42f0-ba2b-7de755022a4f None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:28:31.640646 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-76b3e985-136b-42f0-ba2b-7de755022a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed9847c0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:28:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:31.643090 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3bdf0d60-ad46-4635-853e-992937577376 req-574566bb-64bf-47fe-b062-ab6f5c3f5742 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2767019
May 27 09:28:31.715055 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-13fe0a07-b5ea-414b-a0eb-71f6d494875d req-05f27532-99cd-4bc2-8380-6fa7703c1491 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3 HTTP/1.1" status: 200  len: 999 time: 0.2702057
May 27 09:28:31.957552 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-624d8564-0ecf-4b8b-85cd-b9516ee17ee7 None None] Network 0720c9f4-4d57-4c27-90c2-5ab1f11c1478 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:28:31.976932 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e8341e7-11b7-42e0-b5fb-966f712fd765 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:31.984321 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e8341e7-11b7-42e0-b5fb-966f712fd765 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:32.006656 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-69a4cc2f-5bda-4024-ae8b-c37373ee3236 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:32.109087 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-35f73948-bdae-44fd-a3d0-de97e7fd3243 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:32.141629 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-35f73948-bdae-44fd-a3d0-de97e7fd3243 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:32.147839 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-8e8341e7-11b7-42e0-b5fb-966f712fd765 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=0f59a4cf3fbd48c7af4f77d74f68500d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6311467
May 27 09:28:32.151204 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e8341e7-11b7-42e0-b5fb-966f712fd765 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3c9e15ca-5bf6-4f54-ab76-15121cff30a4,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:32.155585 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48716) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:32.157438 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-35f73948-bdae-44fd-a3d0-de97e7fd3243 admin admin] Usage tracker for resource:security_group_rule and tenant:b35fd55778704eb684dbd3f08f178e32 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:32.181837 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8e8341e7-11b7-42e0-b5fb-966f712fd765 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:32.189510 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-35f73948-bdae-44fd-a3d0-de97e7fd3243 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:32.205773 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-35f73948-bdae-44fd-a3d0-de97e7fd3243 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:32.303901 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48720) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:32.439454 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-76b3e985-136b-42f0-ba2b-7de755022a4f None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:28:32.528639 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13fe0a07-b5ea-414b-a0eb-71f6d494875d req-fb2bab32-77aa-42c6-9400-70cb12a35f02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:32.530426 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-13fe0a07-b5ea-414b-a0eb-71f6d494875d req-fb2bab32-77aa-42c6-9400-70cb12a35f02 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 200  len: 855 time: 0.8007934
May 27 09:28:32.566918 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_v2 [None req-2c05a03b-1617-4465-842a-66d5e25dac9d admin admin] Deleting subnet fe9e7e1e-674a-4cd2-835e-ab14693282cf {{(pid=91820) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:28:32.599562 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2c05a03b-1617-4465-842a-66d5e25dac9d admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:32.673932 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56ee6ffc-2587-4de4-9213-a308b59fde70 req-84219082-9ca1-4109-b84c-884d42277929 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:32.687901 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-56ee6ffc-2587-4de4-9213-a308b59fde70 req-84219082-9ca1-4109-b84c-884d42277929 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.8223369
May 27 09:28:32.811388 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-56ee6ffc-2587-4de4-9213-a308b59fde70 req-399fd8b6-12b9-4c2d-b9be-ad944240ab2b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1219032
May 27 09:28:32.868614 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13fe0a07-b5ea-414b-a0eb-71f6d494875d req-05641650-47f8-4484-9ed1-dca5e207a8c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:32.872226 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-13fe0a07-b5ea-414b-a0eb-71f6d494875d req-05641650-47f8-4484-9ed1-dca5e207a8c1 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=624aa867-a71e-4343-8899-4e49257cd000&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3148932
May 27 09:28:32.927108 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2c05a03b-1617-4465-842a-66d5e25dac9d admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:32.938331 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bc55d8a8-d6cc-41f0-829c-2fa39d36863b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:32.971721 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bc55d8a8-d6cc-41f0-829c-2fa39d36863b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:33.027007 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-35f73948-bdae-44fd-a3d0-de97e7fd3243 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:33.045894 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2c05a03b-1617-4465-842a-66d5e25dac9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:33.082389 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-35f73948-bdae-44fd-a3d0-de97e7fd3243 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:33.100947 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:33.115471 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bc55d8a8-d6cc-41f0-829c-2fa39d36863b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:33.178355 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-35f73948-bdae-44fd-a3d0-de97e7fd3243 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b35fd55778704eb684dbd3f08f178e32&name=default HTTP/1.1" status: 200  len: 2979 time: 1.8815868
May 27 09:28:33.210425 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48728) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:33.221132 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35f73948-bdae-44fd-a3d0-de97e7fd3243 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c44399c-5dae-4751-87cd-1dae9c2fe31e,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:33.225199 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-35f73948-bdae-44fd-a3d0-de97e7fd3243 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:33.231214 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-76b3e985-136b-42f0-ba2b-7de755022a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed9847c0>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '1e925ef8-9c21-49c4-9220-1dc6bad97177', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'floating_ip_address': '172.27.1.79', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'port_id': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 137, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'mac_address': 'fa:16:3e:70:e3:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:27:49Z', 'updated_at': '2021-05-27T09:28:27Z', 'revision_number': 1, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:33.231949 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-01fef9ea-0960-4195-b336-86deb4bffeb6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.100s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:33.239990 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76b3e985-136b-42f0-ba2b-7de755022a4f None None] The sync data for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi is: [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '1e925ef8-9c21-49c4-9220-1dc6bad97177', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'floating_ip_address': '172.27.1.79', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'port_id': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 137, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'mac_address': 'fa:16:3e:70:e3:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:27:49Z', 'updated_at': '2021-05-27T09:28:27Z', 'revision_number': 1, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:28:33.245273 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bc55d8a8-d6cc-41f0-829c-2fa39d36863b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:33.251256 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-bc55d8a8-d6cc-41f0-829c-2fa39d36863b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3c9e15ca-5bf6-4f54-ab76-15121cff30a4 HTTP/1.1" status: 204  len: 168 time: 1.0705965
May 27 09:28:33.316577 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc55d8a8-d6cc-41f0-829c-2fa39d36863b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c9e15ca-5bf6-4f54-ab76-15121cff30a4,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:33.320168 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-bc55d8a8-d6cc-41f0-829c-2fa39d36863b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:33.460068 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-13fe0a07-b5ea-414b-a0eb-71f6d494875d req-b2032963-2aca-4012-b368-51c0f7dcf8ae service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5787549
May 27 09:28:33.660700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2c05a03b-1617-4465-842a-66d5e25dac9d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810'] for subnet, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:33.684812 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-12d25cb7-b4ac-421d-a54b-2d88516e37c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:33.695476 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcbc51e2-e5c8-4f7b-9074-2a6a21472894 None None] New status for floating IP 1e925ef8-9c21-49c4-9220-1dc6bad97177: ACTIVE {{(pid=91822) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:28:33.703758 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8f3dcde4-2c86-4db5-8896-7ba00642b020 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:33.757559 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8f3dcde4-2c86-4db5-8896-7ba00642b020 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:33.877776 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2c05a03b-1617-4465-842a-66d5e25dac9d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:33.898398 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c05a03b-1617-4465-842a-66d5e25dac9d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fe9e7e1e-674a-4cd2-835e-ab14693282cf,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:33.902523 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24871c57-4d2b-4dbb-973d-fc019c02e1e8 req-67b5f920-7ba7-4774-84f4-5bc9c759e427 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:33.912921 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2c05a03b-1617-4465-842a-66d5e25dac9d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:33.916285 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-24871c57-4d2b-4dbb-973d-fc019c02e1e8 req-67b5f920-7ba7-4774-84f4-5bc9c759e427 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 945 time: 0.9890368
May 27 09:28:33.924248 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48748) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:33.925541 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-2c05a03b-1617-4465-842a-66d5e25dac9d admin admin] 10.222.0.30 "DELETE /v2.0/subnets/fe9e7e1e-674a-4cd2-835e-ab14693282cf HTTP/1.1" status: 204  len: 168 time: 1.5935872
May 27 09:28:34.039035 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8f3dcde4-2c86-4db5-8896-7ba00642b020 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:34.059862 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-16569e50-a6c5-4457-bb3c-474405a2906e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:34.182411 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-13fe0a07-b5ea-414b-a0eb-71f6d494875d req-8c5c818c-d7e1-46a7-96d5-073dd79fb573 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.7015007
May 27 09:28:34.215330 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f3dcde4-2c86-4db5-8896-7ba00642b020 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c44399c-5dae-4751-87cd-1dae9c2fe31e,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:34.243980 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-24871c57-4d2b-4dbb-973d-fc019c02e1e8 req-f782ee60-7581-4ba7-9def-c0d26a1e48b4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3259985
May 27 09:28:34.248947 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8f3dcde4-2c86-4db5-8896-7ba00642b020 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:34.347244 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8f3dcde4-2c86-4db5-8896-7ba00642b020 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:34.348759 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-8f3dcde4-2c86-4db5-8896-7ba00642b020 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/1c44399c-5dae-4751-87cd-1dae9c2fe31e HTTP/1.1" status: 204  len: 168 time: 1.1368701
May 27 09:28:34.379185 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:34.654854 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467c0616-b769-4bd6-8680-e917383cfa00 req-fb0b1c4f-014d-4597-bb8c-b7190e253fdd tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:34.663134 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-467c0616-b769-4bd6-8680-e917383cfa00 req-fb0b1c4f-014d-4597-bb8c-b7190e253fdd tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.4072356
May 27 09:28:34.757819 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:34.812255 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f2eec1dd340>> segment before_delete 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:34.812840 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f2eec1dd340>> subnet precommit_delete_associations 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:34.814084 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec33f070>> segment_host_mapping after_create 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:34.814681 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec33f070>> port after_create 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:34.815313 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec33f070>> port after_delete 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:34.815913 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec33f070>> port after_update 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:34.816888 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec33f070>> segment after_delete 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:34.818954 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec33f070>> subnet after_create 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:34.819782 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec33f070>> subnet after_delete 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:34.820462 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec33f070>> subnet after_update 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:35.098188 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f2eec749040>> subnet after_create 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:35.099134 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f2eec749040>> subnet after_delete 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:35.099729 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f2eec749040>> subnet before_create 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:35.100174 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f2eec749040>> subnet before_update 55550000 {{(pid=91821) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:35.100568 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2eec1ddc40>,) {'filters': {'network_id': ['614fa2b9-1890-4e8d-9f9a-f79aaebf515d']}} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:35.147091 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec1ddc40>, '519332c4-0201-4d92-9424-ec0b1d1407e4') {'for_net_delete': True} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:35.147466 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec1ddc40>, '519332c4-0201-4d92-9424-ec0b1d1407e4') {} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:35.186492 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2232170'] for segment, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:35.238679 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-467c0616-b769-4bd6-8680-e917383cfa00 req-fe75290c-4740-4e25-a42c-1b68696a802c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.5742877
May 27 09:28:35.258698 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:35.287760 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Releasing vlan 387 on physical network physnet1 to pool {{(pid=91821) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:28:35.288685 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2157387'] for segment, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   from cryptography.utils import int_from_bytes
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   from cryptography.utils import int_from_bytes
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]: Traceback (most recent call last):
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     timer()
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     cb(*args, **kw)
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     return func(*args, **kwargs)
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     self._notify()
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     self.callback(batched_events)
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     event.method(event)
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     return f(self, *a, **k)
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._get(url).json()
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self.request(url, 'GET', **kwargs)
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:28:35.312406 dv-cinder-772623-6-iscsi neutron-server[91821]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:28:35.439963 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:35.447196 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:35.450438 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:35.480902 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Pushing event deleted for resources: {'Network': ['ID=614fa2b9-1890-4e8d-9f9a-f79aaebf515d,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:35.488925 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:35.505782 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] 10.222.0.30 "DELETE /v2.0/networks/614fa2b9-1890-4e8d-9f9a-f79aaebf515d HTTP/1.1" status: 204  len: 168 time: 1.5590742
May 27 09:28:35.853922 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 48854) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:35.989551 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-fb64dae4-34d1-430b-8c29-7b3ce3b0e927 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=1e809ec6b9624e98a228033a8d2c59f1&name=default HTTP/1.1" status: 200  len: 2975 time: 0.1340799
May 27 09:28:35.993688 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 48866) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:36.127048 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4dd8aa3c-a37c-499d-820d-a696daff0688 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:36.172846 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4dd8aa3c-a37c-499d-820d-a696daff0688 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:36.257934 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4dd8aa3c-a37c-499d-820d-a696daff0688 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:36.280202 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:36.314054 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dd8aa3c-a37c-499d-820d-a696daff0688 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8bf65a1-fc64-4453-8162-f7e810f7e312,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:36.332179 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4dd8aa3c-a37c-499d-820d-a696daff0688 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:36.353076 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4dd8aa3c-a37c-499d-820d-a696daff0688 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:36.355514 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-4dd8aa3c-a37c-499d-820d-a696daff0688 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e8bf65a1-fc64-4453-8162-f7e810f7e312 HTTP/1.1" status: 204  len: 168 time: 0.3598347
May 27 09:28:37.001520 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63abb501-8d2a-4917-801b-58f1ed86752f req-3a8afdcb-5fe9-42fe-905a-f91f67f2820c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:37.003416 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-63abb501-8d2a-4917-801b-58f1ed86752f req-3a8afdcb-5fe9-42fe-905a-f91f67f2820c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2317829
May 27 09:28:37.106433 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-63abb501-8d2a-4917-801b-58f1ed86752f req-437638bb-72f5-4753-be43-46528fa52275 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0952134
May 27 09:28:38.509851 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-b437ff80-5a8c-4b44-8534-98c06fa2dbc7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:38.544239 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49123870-13e3-41bc-a91b-b67df6805467 req-a5ca657b-5eeb-4ae8-98df-a53e17ad1fe9 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:38.545690 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-49123870-13e3-41bc-a91b-b67df6805467 req-a5ca657b-5eeb-4ae8-98df-a53e17ad1fe9 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1308300
May 27 09:28:38.597092 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-49123870-13e3-41bc-a91b-b67df6805467 req-bac23e53-0c32-4ef1-887a-470101a3cdb9 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0449293
May 27 09:28:40.064479 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-4dd1f4d9-c618-4720-a518-03c559e66550 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:40.068372 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-4dd1f4d9-c618-4720-a518-03c559e66550 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 815 time: 0.3505073
May 27 09:28:40.093333 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-bd28099a-1185-4a4f-992b-81d23555664d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/quotas/0daf73d9a2424c3e9ccbe74a9d2d94f5 HTTP/1.1" status: 200  len: 375 time: 0.0167973
May 27 09:28:40.424925 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-686598d0-1253-4287-aa73-d7cff5269fa2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&fields=id HTTP/1.1" status: 200  len: 302 time: 0.3193939
May 27 09:28:40.593960 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86dd82ca-f330-48d8-a9c3-7d3cf5d3f418 req-397061ba-3798-4e7e-a214-17161a2d986b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:40.595580 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-86dd82ca-f330-48d8-a9c3-7d3cf5d3f418 req-397061ba-3798-4e7e-a214-17161a2d986b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.3847635
May 27 09:28:40.634806 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-05a80cf4-1bc2-48b4-8029-ba333c22f9e2 service neutron] 10.222.0.30 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1972177
May 27 09:28:40.738623 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-86dd82ca-f330-48d8-a9c3-7d3cf5d3f418 req-8f8f0477-01dd-48e8-b0d3-a68fc869cdb3 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1295404
May 27 09:28:40.828192 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-a9fc84e0-0434-4374-9690-5213372cf417 service neutron] 10.222.0.30 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1878448
May 27 09:28:41.377751 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0791360e-faf4-4d10-ac40-a84c5d338c1b req-05943310-73cc-48c9-9633-1cbfb84c27fc tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 210 time: 0.0557194
May 27 09:28:41.464226 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:41.799519 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-744c4fe0-59ec-4e58-a429-448bb5fa634a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:42.102461 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e3fca5-6b53-4e2b-a61c-156f05ad7c1a req-c5e33b6a-fab1-4054-b589-43c60db71b76 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:42.104392 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-56e3fca5-6b53-4e2b-a61c-156f05ad7c1a req-c5e33b6a-fab1-4054-b589-43c60db71b76 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1383903
May 27 09:28:42.165085 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-56e3fca5-6b53-4e2b-a61c-156f05ad7c1a req-24955933-7490-48da-b60b-44c07089f9fc tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0535555
May 27 09:28:42.385588 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:42.664478 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9cf53edb-631a-47f8-aac1-d6d80d903e68 req-bbf3c4e5-6fca-4b7e-81e6-a1da71185130 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 210 time: 0.1004806
May 27 09:28:43.438422 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c43147e-770d-4486-98d8-1b857e0a9fe9 req-0b3b0c83-1947-4ce3-9fc8-65f3ee2fce74 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:43.441264 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6c43147e-770d-4486-98d8-1b857e0a9fe9 req-0b3b0c83-1947-4ce3-9fc8-65f3ee2fce74 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1095903
May 27 09:28:43.508487 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6c43147e-770d-4486-98d8-1b857e0a9fe9 req-01190695-9c73-44ad-b77f-7d467982f89b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0553751
May 27 09:28:44.910299 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:46.203029 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7780d778-50a4-4c36-b051-b29b3f3398fe req-a89bbe67-bf00-4718-8d83-ef93a83a6991 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 210 time: 0.0626245
May 27 09:28:46.331529 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-e0d5bfec-5b7e-4d52-9543-e056a5b47b3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:46.334930 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-e0d5bfec-5b7e-4d52-9543-e056a5b47b3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 815 time: 0.3461285
May 27 09:28:46.355163 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Request body: {'port': {'device_id': '902defd6-871d-4189-bff2-6a0defa3a5ab', 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965', 'admin_state_up': True, 'tenant_id': '0daf73d9a2424c3e9ccbe74a9d2d94f5'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:46.594231 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:46.600953 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Usage tracker for resource:port and tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:46.612289 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d998cd91-fb20-4f0c-bb3d-66cfe6b91636 req-921d0168-12d9-4577-9113-25781512c30c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:46.619474 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d998cd91-fb20-4f0c-bb3d-66cfe6b91636 req-921d0168-12d9-4577-9113-25781512c30c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2279081
May 27 09:28:46.619474 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Quota usage for port was recalculated. Used quota:2. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:46.623721 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:46.667587 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Made reservation on behalf of 0daf73d9a2424c3e9ccbe74a9d2d94f5 for: {'port': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:28:46.671341 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:46.705265 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d998cd91-fb20-4f0c-bb3d-66cfe6b91636 req-f5043e50-7854-43e9-b423-a5f7078e1d8f tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0784891
May 27 09:28:46.884723 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Allocated IP 172.20.0.10 (7cbf7538-2626-435d-83dd-e10fb0c9e965/3d70d479-f390-4cd8-90ff-49a918615aa4/494fef8d-4a46-4dc4-8bdc-d2550769b2dd) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:28:47.091769 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:28:47.229371 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:47.290472 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:47.310376 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-b60e5030-b5bd-4678-829c-fa07c7dda659 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:47.310820 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['2890994f-299e-4a4d-8e0a-945b6c38ecfe', '51dd2656-44f3-41cb-b4e3-38beccc875b4'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:28:47.420777 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Network 7cbf7538-2626-435d-83dd-e10fb0c9e965 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:28:47.424579 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:28:47.427659 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:28:47.524619 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:47.525220 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:47.535655 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Pushing event updated for resources: {'Port': ['ID=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:47.546871 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.236s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:47.573446 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.2288074
May 27 09:28:47.592024 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Request body: {'port': {'device_id': '902defd6-871d-4189-bff2-6a0defa3a5ab', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:48.091463 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:48.186905 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-913b5caf-936b-4885-bd14-9485d45edae4 req-1705a00a-a39c-4a18-8ae2-18f1ae275a6d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:48.187703 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-913b5caf-936b-4885-bd14-9485d45edae4 req-1705a00a-a39c-4a18-8ae2-18f1ae275a6d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Synchronizing usage tracker for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:28:48.370433 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-913b5caf-936b-4885-bd14-9485d45edae4 req-1705a00a-a39c-4a18-8ae2-18f1ae275a6d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Unset dirty status for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:28:48.372345 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-913b5caf-936b-4885-bd14-9485d45edae4 req-1705a00a-a39c-4a18-8ae2-18f1ae275a6d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 932 time: 0.4643114
May 27 09:28:48.639079 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-913b5caf-936b-4885-bd14-9485d45edae4 req-174d3ca1-79ed-4020-b82a-69a776f18868 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2553883
May 27 09:28:48.691420 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a040a7-d4de-48f5-82c8-ea87dfa6facd req-8a186d18-eb69-4492-8cbb-8a0174d3c0e3 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:48.695607 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-45a040a7-d4de-48f5-82c8-ea87dfa6facd req-8a186d18-eb69-4492-8cbb-8a0174d3c0e3 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.5045874
May 27 09:28:48.847089 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-45a040a7-d4de-48f5-82c8-ea87dfa6facd req-8efb0148-f6a2-4067-8f3e-467a0e35ceb3 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1425772
May 27 09:28:49.020835 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 494fef8d-4a46-4dc4-8bdc-d2550769b2dd {{(pid=91821) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:28:49.033542 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:49.062967 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Transition to ACTIVE for port object 494fef8d-4a46-4dc4-8bdc-d2550769b2dd will not be triggered until provisioned by entity L2. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:28:49.068103 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:49.072922 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:49.290221 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Pushing event updated for resources: {'Port': ['ID=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:49.297998 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:49.398321 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Attempting to bind port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:28:49.399435 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Attempting to bind port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:28:49.399435 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Attempting to bind port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:28:49.405380 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:28:49.405763 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Attempting to bind port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:28:49.414908 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 28, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:28:49.415327 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Checking segment: {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:28:49.415859 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Bound using segment: {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:28:49.416402 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Bound port: 494fef8d-4a46-4dc4-8bdc-d2550769b2dd, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'}}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:28:49.416824 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:49.541690 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] For port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd, host hv-cinder-77262, cleared binding levels {{(pid=91821) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:28:49.545838 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] For port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91821) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:28:49.550971 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:49.555704 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5207c68e-49d4-4ee7-b618-7d1c5a72e608 tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:49.635465 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:49.636090 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:49.637512 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] 10.222.0.11 "PUT /v2.0/ports/494fef8d-4a46-4dc4-8bdc-d2550769b2dd HTTP/1.1" status: 200  len: 1094 time: 2.0513906
May 27 09:28:49.642332 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '902defd6-871d-4189-bff2-6a0defa3a5ab', 'tag': '494fef8d-4a46-4dc4-8bdc-d2550769b2dd'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:28:49.667663 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Pushing event updated for resources: {'Port': ['ID=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,revision_number=3']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:49.675589 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:49.795327 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '902defd6-871d-4189-bff2-6a0defa3a5ab', 'tag': '494fef8d-4a46-4dc4-8bdc-d2550769b2dd', 'status': 'completed', 'code': 200}
May 27 09:28:49.891104 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-8392ed9e-a74f-4c93-8b0a-e47eadad8697 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:49.906109 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-8392ed9e-a74f-4c93-8b0a-e47eadad8697 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 1097 time: 0.1892931
May 27 09:28:50.142844 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-9cd6bbda-d190-46b4-b56e-87b3c77fbb07 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=494fef8d-4a46-4dc4-8bdc-d2550769b2dd HTTP/1.1" status: 200  len: 217 time: 0.2254772
May 27 09:28:50.414566 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e66497fd-5670-40ee-a89b-9eae39580a9f req-1c5254c4-7c31-49d7-800a-b6cc69fb394c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:50.419316 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e66497fd-5670-40ee-a89b-9eae39580a9f req-1c5254c4-7c31-49d7-800a-b6cc69fb394c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 944 time: 0.5044415
May 27 09:28:50.423682 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-63634ceb-a3e5-4cfd-a10d-48d7b339db49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:50.425367 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-63634ceb-a3e5-4cfd-a10d-48d7b339db49 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3d70d479-f390-4cd8-90ff-49a918615aa4 HTTP/1.1" status: 200  len: 855 time: 0.2695966
May 27 09:28:50.516618 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-be147b36-9382-4bf4-beb4-37e552f8bec0 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7cbf7538-2626-435d-83dd-e10fb0c9e965&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0676937
May 27 09:28:50.624011 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e66497fd-5670-40ee-a89b-9eae39580a9f req-ff884dfe-902c-4158-8788-0bad6effe735 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1935203
May 27 09:28:50.740654 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab65ea0d-89ca-476c-a0d3-23e076190f9b req-cad991a5-f638-48b2-b49c-4e27a5cfef1c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:50.745467 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ab65ea0d-89ca-476c-a0d3-23e076190f9b req-cad991a5-f638-48b2-b49c-4e27a5cfef1c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.5162771
May 27 09:28:50.860992 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-4564c984-3ad8-43af-bbac-4d26073d2a24 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3353724
May 27 09:28:50.868916 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ab65ea0d-89ca-476c-a0d3-23e076190f9b req-e1bd555c-4d33-4cde-bcaf-7afaf2d4b7e6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1089215
May 27 09:28:51.065037 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bd160898-2925-4737-a5bc-a4d757e70ff8 req-8d16f5b9-9dcd-43e1-a0af-b7862b60de50 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1862133
May 27 09:28:51.214338 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89848308-1ca4-4b06-88b3-8d1724c3a941 req-cb4e018d-9d37-4cfa-9eb3-0c825b2a687b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:51.215976 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-89848308-1ca4-4b06-88b3-8d1724c3a941 req-cb4e018d-9d37-4cfa-9eb3-0c825b2a687b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 1097 time: 0.0858679
May 27 09:28:51.411584 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89848308-1ca4-4b06-88b3-8d1724c3a941 req-6a4af47c-610a-4d60-8cde-e3cfa5f8160f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:51.413351 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-89848308-1ca4-4b06-88b3-8d1724c3a941 req-6a4af47c-610a-4d60-8cde-e3cfa5f8160f service neutron] 10.222.0.11 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 916 time: 0.1888046
May 27 09:28:51.508165 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-89848308-1ca4-4b06-88b3-8d1724c3a941 req-52cb7ecf-738e-45b9-8e82-d39db5539307 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=494fef8d-4a46-4dc4-8bdc-d2550769b2dd HTTP/1.1" status: 200  len: 217 time: 0.0796664
May 27 09:28:51.614662 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89848308-1ca4-4b06-88b3-8d1724c3a941 req-294c483e-4ac0-40a7-9079-c917b5c8b776 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:51.616792 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-89848308-1ca4-4b06-88b3-8d1724c3a941 req-294c483e-4ac0-40a7-9079-c917b5c8b776 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3d70d479-f390-4cd8-90ff-49a918615aa4 HTTP/1.1" status: 200  len: 855 time: 0.0964596
May 27 09:28:51.706821 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-89848308-1ca4-4b06-88b3-8d1724c3a941 req-f209db70-2e69-4e79-acf8-211fded358c3 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7cbf7538-2626-435d-83dd-e10fb0c9e965&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0816350
May 27 09:28:51.743114 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49250) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:52.080176 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-89848308-1ca4-4b06-88b3-8d1724c3a941 req-f374b086-733a-475c-9408-76010e24b722 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3547440
May 27 09:28:52.122462 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6f7132d6-ae67-44f2-a35d-f06618f8097c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:52.173346 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-6f7132d6-ae67-44f2-a35d-f06618f8097c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:52.182479 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-6f7132d6-ae67-44f2-a35d-f06618f8097c admin admin] Usage tracker for resource:security_group_rule and tenant:98962614f631493aaf07a369afc9398d is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:52.186546 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-6f7132d6-ae67-44f2-a35d-f06618f8097c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:52.195614 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-6f7132d6-ae67-44f2-a35d-f06618f8097c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:52.322942 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b251e64b-cd53-4d4c-870b-d51922107463 req-e54bce28-c4eb-4e48-b264-cbf2f1b5bb69 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:52.324384 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b251e64b-cd53-4d4c-870b-d51922107463 req-e54bce28-c4eb-4e48-b264-cbf2f1b5bb69 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 944 time: 0.4163816
May 27 09:28:52.378112 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6f7132d6-ae67-44f2-a35d-f06618f8097c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:52.391554 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6f7132d6-ae67-44f2-a35d-f06618f8097c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:52.416826 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-89848308-1ca4-4b06-88b3-8d1724c3a941 req-a3e973f8-16eb-4419-8ffb-e9f12e248ad6 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3149190
May 27 09:28:52.451788 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b251e64b-cd53-4d4c-870b-d51922107463 req-9d15a94d-795e-4d88-a00f-4587034fce80 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1063700
May 27 09:28:52.466944 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-54e97ad2-31b9-4b8a-885b-6be3895c1c73 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:52.543700 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-6f7132d6-ae67-44f2-a35d-f06618f8097c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=98962614f631493aaf07a369afc9398d&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7956202
May 27 09:28:52.543700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f7132d6-ae67-44f2-a35d-f06618f8097c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8918e47-73a2-4ead-b387-fcbb07f1df4d,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:52.546766 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49278) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:52.552176 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6f7132d6-ae67-44f2-a35d-f06618f8097c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:52.659762 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12dd45b-b693-4b55-93e4-ca109ca9b350 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:52.690134 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-223f0b67-5961-46cd-a52b-87f0570824e9 req-ef539500-0774-44a5-b22b-3a098f06005e tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:52.699508 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12dd45b-b693-4b55-93e4-ca109ca9b350 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:52.711744 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-223f0b67-5961-46cd-a52b-87f0570824e9 req-ef539500-0774-44a5-b22b-3a098f06005e tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1874695
May 27 09:28:52.783036 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12dd45b-b693-4b55-93e4-ca109ca9b350 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:52.787898 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:52.792376 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-223f0b67-5961-46cd-a52b-87f0570824e9 req-73d0fcea-850b-4026-8ff2-3399326af729 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0790358
May 27 09:28:52.798894 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 49282) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:52.801103 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c12dd45b-b693-4b55-93e4-ca109ca9b350 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8918e47-73a2-4ead-b387-fcbb07f1df4d,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:52.809428 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c12dd45b-b693-4b55-93e4-ca109ca9b350 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:52.819077 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c12dd45b-b693-4b55-93e4-ca109ca9b350 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:52.823414 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-c12dd45b-b693-4b55-93e4-ca109ca9b350 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d8918e47-73a2-4ead-b387-fcbb07f1df4d HTTP/1.1" status: 204  len: 168 time: 0.2722063
May 27 09:28:53.002119 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-27df5106-a0be-4f6b-b5d7-76801be17383 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:53.032943 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-27df5106-a0be-4f6b-b5d7-76801be17383 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:53.040230 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-27df5106-a0be-4f6b-b5d7-76801be17383 admin admin] Usage tracker for resource:security_group_rule and tenant:9fcb86b422f04f3d9347a0f4811a3a5b is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:53.045568 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-27df5106-a0be-4f6b-b5d7-76801be17383 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:53.057963 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-27df5106-a0be-4f6b-b5d7-76801be17383 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:53.187735 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-27df5106-a0be-4f6b-b5d7-76801be17383 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:53.194396 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-27df5106-a0be-4f6b-b5d7-76801be17383 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:53.201940 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-1dbed816-198b-4331-920b-4dbc9197a8b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:53.281965 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-27df5106-a0be-4f6b-b5d7-76801be17383 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9fcb86b422f04f3d9347a0f4811a3a5b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4814246
May 27 09:28:53.284711 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49300) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:53.284949 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27df5106-a0be-4f6b-b5d7-76801be17383 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c7ed209-4720-4bf5-9cbb-9fd219bb7828,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:53.291510 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-27df5106-a0be-4f6b-b5d7-76801be17383 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:53.393158 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d8986f6f-611d-4254-972d-0c953e8cedc7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:53.436290 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d8986f6f-611d-4254-972d-0c953e8cedc7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:53.526796 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d8986f6f-611d-4254-972d-0c953e8cedc7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:53.532318 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:53.549516 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8986f6f-611d-4254-972d-0c953e8cedc7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c7ed209-4720-4bf5-9cbb-9fd219bb7828,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:53.554273 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d8986f6f-611d-4254-972d-0c953e8cedc7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:53.562042 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d8986f6f-611d-4254-972d-0c953e8cedc7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:53.567535 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-d8986f6f-611d-4254-972d-0c953e8cedc7 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6c7ed209-4720-4bf5-9cbb-9fd219bb7828 HTTP/1.1" status: 204  len: 168 time: 0.2808523
May 27 09:28:54.083252 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a5fafdc-9250-40d1-bb5a-38fd4862fe64 req-a1621b85-f845-412a-8b55-20b68020c410 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:54.085487 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2a5fafdc-9250-40d1-bb5a-38fd4862fe64 req-a1621b85-f845-412a-8b55-20b68020c410 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 944 time: 0.2400765
May 27 09:28:54.166850 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2a5fafdc-9250-40d1-bb5a-38fd4862fe64 req-f8257f16-55d6-420e-9c9f-81fa915a3b4e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0702786
May 27 09:28:54.330599 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49332) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:54.377643 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e242922b-e621-4469-93fe-76eef2e4eff5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:54.420795 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33d56264-77e4-4d86-b719-1a9fc3480ab6 req-404e2ebd-13bb-417c-ba7d-9f203dd6c1cc tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:54.421600 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e242922b-e621-4469-93fe-76eef2e4eff5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:54.422374 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-33d56264-77e4-4d86-b719-1a9fc3480ab6 req-404e2ebd-13bb-417c-ba7d-9f203dd6c1cc tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1376886
May 27 09:28:54.432541 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e242922b-e621-4469-93fe-76eef2e4eff5 admin admin] Usage tracker for resource:security_group_rule and tenant:3ad8348ee1394dee8e335c2e73f8c200 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:54.443112 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e242922b-e621-4469-93fe-76eef2e4eff5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:54.463742 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e242922b-e621-4469-93fe-76eef2e4eff5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:54.544742 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-33d56264-77e4-4d86-b719-1a9fc3480ab6 req-c73dac2a-0654-4cb3-aa05-1e487a03c0d9 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1139388
May 27 09:28:54.674444 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e242922b-e621-4469-93fe-76eef2e4eff5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:54.680139 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e242922b-e621-4469-93fe-76eef2e4eff5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:54.690058 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6f7132d6-ae67-44f2-a35d-f06618f8097c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:54.743489 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e242922b-e621-4469-93fe-76eef2e4eff5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0bda7f58-965b-448c-a364-4f34f8c6388d,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:54.747246 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e242922b-e621-4469-93fe-76eef2e4eff5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:54.751363 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-e242922b-e621-4469-93fe-76eef2e4eff5 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=3ad8348ee1394dee8e335c2e73f8c200&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4182334
May 27 09:28:54.755733 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 49346) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:54.857164 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-87663148-7c50-4a4b-8f3a-6fb87bdde830 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:54.913924 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-87663148-7c50-4a4b-8f3a-6fb87bdde830 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:55.025029 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-87663148-7c50-4a4b-8f3a-6fb87bdde830 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:55.036193 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-1f41d9e7-5537-487c-a053-105418d166dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:55.063740 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87663148-7c50-4a4b-8f3a-6fb87bdde830 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0bda7f58-965b-448c-a364-4f34f8c6388d,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:55.068428 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-87663148-7c50-4a4b-8f3a-6fb87bdde830 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:55.085611 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-87663148-7c50-4a4b-8f3a-6fb87bdde830 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:55.093553 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-87663148-7c50-4a4b-8f3a-6fb87bdde830 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/0bda7f58-965b-448c-a364-4f34f8c6388d HTTP/1.1" status: 204  len: 168 time: 0.3358891
May 27 09:28:55.382589 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 494fef8d-4a46-4dc4-8bdc-d2550769b2dd details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:28:55.531863 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a8fb9f5-c3c5-4e1e-bef2-745ffc6f4709 req-66ea3862-e4de-45da-82b7-fdb297d7c379 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:55.541669 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8a8fb9f5-c3c5-4e1e-bef2-745ffc6f4709 req-66ea3862-e4de-45da-82b7-fdb297d7c379 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 944 time: 0.2276406
May 27 09:28:55.640006 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8a8fb9f5-c3c5-4e1e-bef2-745ffc6f4709 req-0dbbdcc4-c729-4710-b498-60a29e45e118 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0973461
May 27 09:28:55.648255 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:55.683815 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '494fef8d-4a46-4dc4-8bdc-d2550769b2dd', 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965', 'port_id': '494fef8d-4a46-4dc4-8bdc-d2550769b2dd', 'mac_address': 'fa:16:3e:48:5d:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 386, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3d70d479-f390-4cd8-90ff-49a918615aa4', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:28:55.807523 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:55.838550 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 494fef8d-4a46-4dc4-8bdc-d2550769b2dd {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:28:55.876282 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:28:55.883059 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49386) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:55.883937 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:55.889882 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:55.972548 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9b4b24-7874-44a4-a986-fb41687799bb req-a23d10c4-7f03-4ca9-ab78-498f47717e75 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:55.975249 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ed9b4b24-7874-44a4-a986-fb41687799bb req-a23d10c4-7f03-4ca9-ab78-498f47717e75 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1334944
May 27 09:28:56.029798 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-79968318-cbad-4957-bdfd-f3d30ba7b440 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:56.034761 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ed9b4b24-7874-44a4-a986-fb41687799bb req-a401cff3-bb59-47ca-b825-6c57fcc8eb5d tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0505397
May 27 09:28:56.044722 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:56.049591 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:56.057987 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-79968318-cbad-4957-bdfd-f3d30ba7b440 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:56.062451 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-79968318-cbad-4957-bdfd-f3d30ba7b440 admin admin] Usage tracker for resource:security_group_rule and tenant:629a133af12248968ed61989fba90a9e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:56.069002 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-79968318-cbad-4957-bdfd-f3d30ba7b440 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:56.074276 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-79968318-cbad-4957-bdfd-f3d30ba7b440 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:56.196028 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-79968318-cbad-4957-bdfd-f3d30ba7b440 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:56.202091 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-79968318-cbad-4957-bdfd-f3d30ba7b440 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:56.255095 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7afa9dc1-75bc-4ff5-9970-ab0e5f40790e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:56.275081 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-79968318-cbad-4957-bdfd-f3d30ba7b440 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=629a133af12248968ed61989fba90a9e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3853889
May 27 09:28:56.275624 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 49396) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:56.280696 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['494fef8d-4a46-4dc4-8bdc-d2550769b2dd'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:28:56.308404 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79968318-cbad-4957-bdfd-f3d30ba7b440 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=759c7372-80da-45b7-9ff2-bc67b485f5cb,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:56.313928 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-79968318-cbad-4957-bdfd-f3d30ba7b440 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:56.458462 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:56.489409 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a0012642-c1fd-46c8-87ed-127ccbcd25a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:56.548382 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a0012642-c1fd-46c8-87ed-127ccbcd25a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:56.694732 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a0012642-c1fd-46c8-87ed-127ccbcd25a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:56.709328 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-d652239a-f5b9-4a9a-a4b1-a33ccb4dcf90 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:56.736423 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0012642-c1fd-46c8-87ed-127ccbcd25a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=759c7372-80da-45b7-9ff2-bc67b485f5cb,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:56.743795 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a0012642-c1fd-46c8-87ed-127ccbcd25a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:56.745493 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a0012642-c1fd-46c8-87ed-127ccbcd25a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:56.751653 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-a0012642-c1fd-46c8-87ed-127ccbcd25a9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/759c7372-80da-45b7-9ff2-bc67b485f5cb HTTP/1.1" status: 204  len: 168 time: 0.4719434
May 27 09:28:57.107305 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56704c52-2a92-404d-98fc-30ad3f455a79 req-bf2d9375-5e53-4426-8a31-0e360917e32c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:57.110014 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-56704c52-2a92-404d-98fc-30ad3f455a79 req-bf2d9375-5e53-4426-8a31-0e360917e32c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 945 time: 0.2280922
May 27 09:28:57.203631 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-56704c52-2a92-404d-98fc-30ad3f455a79 req-3765313d-c5ec-4554-9ded-7b7f8d0dacd2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0799577
May 27 09:28:57.319983 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 49428) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:57.546808 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_v2 [None req-48370eb1-56ba-4b5e-9e6c-1b2746b9074c admin admin] Deleting subnet d97ae7ef-a379-429e-a964-20071e6f1131 {{(pid=91821) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:28:57.558305 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-48370eb1-56ba-4b5e-9e6c-1b2746b9074c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:57.638120 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-48370eb1-56ba-4b5e-9e6c-1b2746b9074c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2232147'] for subnet, precommit_delete_associations {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:57.671812 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16133edf-34b3-4653-b8da-4c983833cfbe req-43f5684a-d4c6-4d0c-9f1e-fd5e7f401db7 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:57.673420 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-16133edf-34b3-4653-b8da-4c983833cfbe req-43f5684a-d4c6-4d0c-9f1e-fd5e7f401db7 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2914572
May 27 09:28:57.748907 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-16133edf-34b3-4653-b8da-4c983833cfbe req-875d3a20-329c-40cc-8d24-f3a0d018535a tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0595582
May 27 09:28:57.749995 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-48370eb1-56ba-4b5e-9e6c-1b2746b9074c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.035732 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-48370eb1-56ba-4b5e-9e6c-1b2746b9074c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2158057', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2399650'] for subnet, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.040176 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-12919037-1b45-48c1-b230-738cc5411c25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:58.043668 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49466) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:58.083481 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48370eb1-56ba-4b5e-9e6c-1b2746b9074c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d97ae7ef-a379-429e-a964-20071e6f1131,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:58.086949 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-48370eb1-56ba-4b5e-9e6c-1b2746b9074c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:58.088004 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-48370eb1-56ba-4b5e-9e6c-1b2746b9074c admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.101161 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-48370eb1-56ba-4b5e-9e6c-1b2746b9074c admin admin] 10.222.0.30 "DELETE /v2.0/subnets/d97ae7ef-a379-429e-a964-20071e6f1131 HTTP/1.1" status: 204  len: 168 time: 0.7741721
May 27 09:28:58.101432 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49474) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:58.201597 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-470552088-network', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:58.217249 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:58.226250 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Usage tracker for resource:network and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:58.230400 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:58.235224 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.241332 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:58.285255 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Made reservation on behalf of a31154df1ce4420f9bdf53b8b3b3649e for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:28:58.288241 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.324222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.389404 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:58.412923 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Usage tracker for resource:security_group_rule and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:58.417555 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:58.426969 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.434057 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e193ab58-d4b2-4800-9a6d-78b5d6afb57a req-a1dbbf8f-d4f7-4cfb-9219-1503083174fa tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:58.434851 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:58.435627 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e193ab58-d4b2-4800-9a6d-78b5d6afb57a req-a1dbbf8f-d4f7-4cfb-9219-1503083174fa tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 945 time: 0.0886743
May 27 09:28:58.445901 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x7f2eed6fae50>> segment before_delete 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.446268 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x7f2eed6fae50>> subnet precommit_delete_associations 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.446993 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec7204f0>> segment_host_mapping after_create 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.447391 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec7204f0>> port after_create 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.447726 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec7204f0>> port after_delete 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.448068 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec7204f0>> port after_update 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.448424 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec7204f0>> segment after_delete 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.448722 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec7204f0>> subnet after_create 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.449065 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec7204f0>> subnet after_delete 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.449396 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x7f2eec7204f0>> subnet after_update 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.487253 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e193ab58-d4b2-4800-9a6d-78b5d6afb57a req-5983121c-cac2-4787-aff2-111792e1dd4e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0456433
May 27 09:28:58.538203 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f2eec62a1c0>> subnet after_create 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.538547 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f2eec62a1c0>> subnet after_delete 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.538875 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f2eec62a1c0>> subnet before_create 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.539220 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x7f2eec62a1c0>> subnet before_update 55550000 {{(pid=91820) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}}
May 27 09:28:58.539617 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2eed6fa070>,) {'filters': {'network_id': ['282e7a70-510f-4fb1-bf23-c15fbeafc68f']}} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:58.557942 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eed6fa070>, '85dd26b8-fc5d-4c62-a263-46995c72f5bd') {'for_net_delete': True} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:58.558213 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eed6fa070>, '85dd26b8-fc5d-4c62-a263-46995c72f5bd') {} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:28:58.580719 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3483835'] for segment, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.608457 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.624096 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Releasing vlan 395 on physical network physnet1 to pool {{(pid=91820) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:28:58.624501 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2421763'] for segment, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   from cryptography.utils import int_from_bytes
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   from cryptography.utils import int_from_bytes
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]: Traceback (most recent call last):
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     timer()
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     cb(*args, **kw)
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     return func(*args, **kwargs)
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     self._notify()
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     self.callback(batched_events)
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     event.method(event)
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     return f(self, *a, **k)
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._get(url).json()
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self.request(url, 'GET', **kwargs)
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:28:58.642808 dv-cinder-772623-6-iscsi neutron-server[91820]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:28:58.761402 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.778808 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:58.793193 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.800513 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.804386 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.810427 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Pushing event deleted for resources: {'Network': ['ID=282e7a70-510f-4fb1-bf23-c15fbeafc68f,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:58.816202 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:58.819608 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-bbf6f3ef-73d8-4c72-b99e-b15e9244c4d1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.010s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:58.859108 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] vlan segment allocate from pool success with {'vlan_id': 381, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:28:58.870561 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] 10.222.0.30 "DELETE /v2.0/networks/282e7a70-510f-4fb1-bf23-c15fbeafc68f HTTP/1.1" status: 204  len: 168 time: 0.7685275
May 27 09:28:58.872790 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c51bd7a6-7968-4acc-acd8-342d1b7e9335,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:58.876386 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49488) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:58.877436 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:58.913759 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.914094 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Added segment c23b4556-4fa1-45f3-b823-f454f9da8056 of type vlan for network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba
May 27 09:28:58.975714 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:58.985477 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_v2 [None req-c0326bb7-1469-4f71-800c-97dd179b4e2a admin admin] Deleting subnet a73cdc30-5c64-48b7-be2c-1b2ea92c9bfd {{(pid=91820) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:28:58.989389 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c0326bb7-1469-4f71-800c-97dd179b4e2a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:59.042322 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c0326bb7-1469-4f71-800c-97dd179b4e2a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3483778'] for subnet, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:59.119454 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c0326bb7-1469-4f71-800c-97dd179b4e2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:59.120622 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9bc54f2-05ee-4637-902a-e0104380320b req-749465cb-49e1-4a95-8d5a-f00b04a32819 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:59.122572 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c9bc54f2-05ee-4637-902a-e0104380320b req-749465cb-49e1-4a95-8d5a-f00b04a32819 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1529443
May 27 09:28:59.168851 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:59.172530 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:28:59.173409 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:59.179178 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c9bc54f2-05ee-4637-902a-e0104380320b req-3b550ff2-2dd6-465e-8f6c-a969a2a8d56e tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0473738
May 27 09:28:59.181459 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c12de596-6222-4d2b-9f82-09363fb6b467 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:59.397110 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 1.3520551
May 27 09:28:59.402435 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 49504) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:59.405534 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Pushing event updated for resources: {'Network': ['ID=1f49b134-af0c-46a8-b862-f6cb6b6a0bba,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:59.409662 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.228s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:59.415932 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 494fef8d-4a46-4dc4-8bdc-d2550769b2dd up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:28:59.419099 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Request body: {'subnet': {'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-470552088-subnet', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'ip_version': 4}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:28:59.432575 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:28:59.446823 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Usage tracker for resource:subnet and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:28:59.453841 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:28:59.469112 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:28:59.475053 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:28:59.489432 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Made reservation on behalf of a31154df1ce4420f9bdf53b8b3b3649e for: {'subnet': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:28:59.493944 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2399631'] for subnet, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:59.597246 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c0326bb7-1469-4f71-800c-97dd179b4e2a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2421409', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2490042'] for subnet, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:59.605897 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:28:59.647855 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0326bb7-1469-4f71-800c-97dd179b4e2a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a73cdc30-5c64-48b7-be2c-1b2ea92c9bfd,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:28:59.652505 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c0326bb7-1469-4f71-800c-97dd179b4e2a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:28:59.657097 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c0326bb7-1469-4f71-800c-97dd179b4e2a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:59.665402 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-c0326bb7-1469-4f71-800c-97dd179b4e2a admin admin] 10.222.0.30 "DELETE /v2.0/subnets/a73cdc30-5c64-48b7-be2c-1b2ea92c9bfd HTTP/1.1" status: 204  len: 168 time: 0.7869148
May 27 09:28:59.670749 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 49510) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:28:59.773290 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:28:59.780250 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:28:59.781124 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:59.913819 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:28:59.996671 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:00.013595 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3b51c28-a37f-48b0-84a3-72ac63335db7 req-ad0e7871-f068-43b6-9be4-6eb569cefc87 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:00.015442 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e3b51c28-a37f-48b0-84a3-72ac63335db7 req-ad0e7871-f068-43b6-9be4-6eb569cefc87 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 945 time: 0.3207407
May 27 09:29:00.040584 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '902defd6-871d-4189-bff2-6a0defa3a5ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '494fef8d-4a46-4dc4-8bdc-d2550769b2dd'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:29:00.052178 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:29:00.059580 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:00.061943 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:00.141072 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '902defd6-871d-4189-bff2-6a0defa3a5ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '494fef8d-4a46-4dc4-8bdc-d2550769b2dd', 'code': 200}
May 27 09:29:00.145878 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:00.149460 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:00.230210 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:00.395502 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e3b51c28-a37f-48b0-84a3-72ac63335db7 req-cb85e644-0f21-4aa6-83d1-4553a21cc1bc tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3583856
May 27 09:29:00.402703 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2eec0f32b0>,) {'filters': {'network_id': ['0720c9f4-4d57-4c27-90c2-5ab1f11c1478']}} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:00.418931 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec0f32b0>, 'd1235ce8-44b0-4268-ab6a-fd54c53df214') {'for_net_delete': True} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:00.419216 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec0f32b0>, 'd1235ce8-44b0-4268-ab6a-fd54c53df214') {} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:00.440075 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2232170'] for segment, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:00.513219 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:00.564133 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] Releasing vlan 394 on physical network physnet1 to pool {{(pid=91821) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:29:00.564478 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2157387'] for segment, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]: Traceback (most recent call last):
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     timer()
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     cb(*args, **kw)
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     return func(*args, **kwargs)
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     self._notify()
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     self.callback(batched_events)
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     event.method(event)
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     return f(self, *a, **k)
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._get(url).json()
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self.request(url, 'GET', **kwargs)
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:29:00.579694 dv-cinder-772623-6-iscsi neutron-server[91821]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:29:00.699217 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:00.725833 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-482f2331-c196-486c-83dd-e96e3a867437 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:00.753720 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:00.761377 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] Pushing event deleted for resources: {'Network': ['ID=0720c9f4-4d57-4c27-90c2-5ab1f11c1478,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:00.769346 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21412a14-8ed7-46dc-9e23-8aa3699939d5 req-953371f8-11c8-417c-b340-924ca3d5a445 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:00.771637 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-21412a14-8ed7-46dc-9e23-8aa3699939d5 req-953371f8-11c8-417c-b340-924ca3d5a445 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 1099 time: 0.3198276
May 27 09:29:00.775165 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:00.783354 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-af0117ca-2060-4c30-b178-ce9faf7d9e24 admin admin] 10.222.0.30 "DELETE /v2.0/networks/0720c9f4-4d57-4c27-90c2-5ab1f11c1478 HTTP/1.1" status: 204  len: 168 time: 1.1115918
May 27 09:29:00.811280 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a97a1150-1fe9-4392-aba6-59690bc77776 req-891d1e67-b7b2-46e2-80c1-059a78820220 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:00.812895 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a97a1150-1fe9-4392-aba6-59690bc77776 req-891d1e67-b7b2-46e2-80c1-059a78820220 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.3101301
May 27 09:29:00.988907 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-21412a14-8ed7-46dc-9e23-8aa3699939d5 req-3aff3cff-a0ab-4d24-b88d-b22b66990746 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2069123
May 27 09:29:01.015666 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a97a1150-1fe9-4392-aba6-59690bc77776 req-598130ef-b658-4c44-b671-1cd5638ba8fc tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1861279
May 27 09:29:01.031827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2157992', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2399641'] for subnet, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:01.040601 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:01.076018 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49534) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:01.177388 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6659533b-b3b0-4d3c-8bf0-709a19b7728d,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:01.182928 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:01.184299 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Checking segment: {'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:29:01.184862 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Network hostable DHCP agents. Network: 1f49b134-af0c-46a8-b862-f6cb6b6a0bba, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91821) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:29:01.191242 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-5b403de3-5101-443c-a76d-2e38a68ecac8 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=5d8ff0207b124e228a321e3108bca264&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1112208
May 27 09:29:01.194001 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49540) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:01.206166 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91821) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:29:01.217591 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 1f49b134-af0c-46a8-b862-f6cb6b6a0bba) {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:29:01.228436 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:01.229606 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:01.234971 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5e6df69d-5f63-42eb-a5f7-590cf5226691 None None] Network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:29:01.266452 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49544) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:01.267140 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 844 time: 1.8625808
May 27 09:29:01.279496 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:01.289908 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:01.297335 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Usage tracker for resource:router and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:01.308886 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:01.320399 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:01.326434 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6f6dbcd1-238f-4074-89b8-b612d4bbc98c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:01.360174 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6f6dbcd1-238f-4074-89b8-b612d4bbc98c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:01.375034 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3812772', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1963'] for router, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:01.376604 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3855012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3811180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3881146', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1952'] for router, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:01.425993 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:01.515925 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6f6dbcd1-238f-4074-89b8-b612d4bbc98c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:01.526778 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:01.574545 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp391d76a4-97d4-5c01-84fd-9bc405269bae-1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d'}]}} from dv-cinder-772623-6-iscsi. {{(pid=91822) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 27 09:29:01.575428 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:01.691838 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f2f4bc-5b2f-4037-8cf3-c79f83a5bd3a req-3ce3c7fa-7751-4a8e-bccd-2bce2731fc1d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:01.694462 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-07f2f4bc-5b2f-4037-8cf3-c79f83a5bd3a req-3ce3c7fa-7751-4a8e-bccd-2bce2731fc1d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 946 time: 0.1559105
May 27 09:29:01.696232 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f6dbcd1-238f-4074-89b8-b612d4bbc98c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ff373bf-972c-40e3-bd47-5c1014c549df,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:01.702560 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6f6dbcd1-238f-4074-89b8-b612d4bbc98c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:01.769539 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-07f2f4bc-5b2f-4037-8cf3-c79f83a5bd3a req-387094fd-eb3b-48be-8314-39a20f9d0baa tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0563233
May 27 09:29:01.829473 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6f6dbcd1-238f-4074-89b8-b612d4bbc98c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:01.831415 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-6f6dbcd1-238f-4074-89b8-b612d4bbc98c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/7ff373bf-972c-40e3-bd47-5c1014c549df HTTP/1.1" status: 204  len: 168 time: 0.6353476
May 27 09:29:01.852024 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3811195', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3812794', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2006'] for router, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:01.871826 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.db_base_plugin_common [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Allocated IP 172.20.0.2 (1f49b134-af0c-46a8-b862-f6cb6b6a0bba/6659533b-b3b0-4d3c-8bf0-709a19b7728d/32714a80-7bbc-4667-b4b7-e4274ceab763) {{(pid=91822) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:29:02.238232 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Notify callbacks [] for port, precommit_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.260860 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Transition to ACTIVE for port object 32714a80-7bbc-4667-b4b7-e4274ceab763 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:29:02.296753 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Transition to ACTIVE for port object 32714a80-7bbc-4667-b4b7-e4274ceab763 will not be triggered until provisioned by entity DHCP. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:29:02.321248 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.330390 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:02.344689 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.378571 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.449359 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba is already hosted by enough agents. {{(pid=91822) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:29:02.455316 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 49564) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:02.455798 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.base_scheduler [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Resources bound (agent type, host, resource id):  {{(pid=91822) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:29:02.463083 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Received port after_create {{(pid=91822) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:29:02.528835 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-74e5983f-a1cd-4b7e-87e1-415fb78afe2f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=1973c8a9071149949e1ee94ec5f8e419&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0715578
May 27 09:29:02.531168 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 49568) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:02.547968 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Pushing event updated for resources: {'Port': ['ID=32714a80-7bbc-4667-b4b7-e4274ceab763,revision_number=1']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:02.570062 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Allocated IP 172.27.1.21 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/0137aec9-4829-4ec4-ac35-42db2874bf00) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:29:02.605453 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.275s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:02.612404 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.649071 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.682847 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Attempting to bind port 32714a80-7bbc-4667-b4b7-e4274ceab763 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:29:02.683207 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Attempting to bind port 32714a80-7bbc-4667-b4b7-e4274ceab763 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:29:02.683609 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Attempting to bind port 32714a80-7bbc-4667-b4b7-e4274ceab763 on network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:29:02.689953 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 28, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:29:02.690395 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Checking segment: {'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:29:02.690833 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.691160 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Bound using segment: {'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:29:02.691863 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Bound port: 32714a80-7bbc-4667-b4b7-e4274ceab763, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:29:02.692325 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.732575 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.737853 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:02.751319 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6902932b-3a82-484f-928b-6db6b40ff79a,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:02.762608 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.763077 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.763610 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.764031 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.764446 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.764866 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.765313 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.765755 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.766192 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.766646 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.767103 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.767566 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:02.771759 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:02.773023 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.778307 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6902932b-3a82-484f-928b-6db6b40ff79a HTTP/1.1" status: 204  len: 168 time: 0.2458231
May 27 09:29:02.798640 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.835653 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] For port 32714a80-7bbc-4667-b4b7-e4274ceab763, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:29:02.840056 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] For port 32714a80-7bbc-4667-b4b7-e4274ceab763, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=32714a80-7bbc-4667-b4b7-e4274ceab763,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:29:02.845912 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.851309 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:02.854072 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:02.862152 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3f66f6e0-0976-49fd-950f-668fa1b85ec4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:02.942477 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Pushing event updated for resources: {'Port': ['ID=32714a80-7bbc-4667-b4b7-e4274ceab763,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:02.945888 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:02.987755 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:29:02.994622 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:29:03.001567 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:29:03.071770 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Pushing event updated for resources: {'Port': ['ID=0137aec9-4829-4ec4-ac35-42db2874bf00,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:03.094535 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.094991 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.095512 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.095815 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.096498 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.097012 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.097572 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.098723 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.099482 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.099844 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.100296 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.100760 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:03.106648 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.245s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:03.636026 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:04.193678 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bcad4b18-12c7-4644-8719-1bfdaa4027dd None None] Network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:29:04.216736 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 32714a80-7bbc-4667-b4b7-e4274ceab763 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:04.241946 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3812787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3811082'] for router, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:04.426182 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-20bd4d26-5bb2-4d5a-a41b-61cfc36ab311 None None] Provisioning for port 32714a80-7bbc-4667-b4b7-e4274ceab763 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:29:04.482459 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Router 9a650133-6433-44b6-9741-b3bd050216ae is scheduled to L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 with binding_index 1 {{(pid=91820) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 27 09:29:04.730473 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bb6024e-5694-4af7-a961-eb5870064af9 req-6574e5a4-d450-425b-838d-3c466ef123a4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:04.738150 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8bb6024e-5694-4af7-a961-eb5870064af9 req-6574e5a4-d450-425b-838d-3c466ef123a4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1267688
May 27 09:29:04.798862 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 32714a80-7bbc-4667-b4b7-e4274ceab763 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:29:04.827237 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 32714a80-7bbc-4667-b4b7-e4274ceab763 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:04.830142 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:04.843485 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8bb6024e-5694-4af7-a961-eb5870064af9 req-85b857cb-7958-4322-82ac-3068da98aa48 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1038311
May 27 09:29:04.886965 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8559d26f-0157-4bf6-921b-c06ad331def3 req-7383f714-0b98-47fe-91f1-f12b077f08c4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:04.901485 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8559d26f-0157-4bf6-921b-c06ad331def3 req-7383f714-0b98-47fe-91f1-f12b077f08c4 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 946 time: 0.1459529
May 27 09:29:04.930114 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:29:04.967068 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Sync routers for ids ['9a650133-6433-44b6-9741-b3bd050216ae'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:29:04.990597 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Routers {'9a650133-6433-44b6-9741-b3bd050216ae'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:29:04.992506 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd84250>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:28:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['9a650133-6433-44b6-9741-b3bd050216ae'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:05.081623 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Notify callbacks [] for router, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:05.083206 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8559d26f-0157-4bf6-921b-c06ad331def3 req-47111fbb-b322-48f1-b4ec-a18fba6fb390 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1790283
May 27 09:29:05.086992 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201  len: 919 time: 3.8190303
May 27 09:29:05.087681 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49606) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:05.256171 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:05.335830 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 32714a80-7bbc-4667-b4b7-e4274ceab763, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=32714a80-7bbc-4667-b4b7-e4274ceab763,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:29:05.345858 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:05.353614 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:05.515772 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=32714a80-7bbc-4667-b4b7-e4274ceab763,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:05.520016 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:05.555225 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-65fa0973-5861-48af-ab86-193b3949bf18 None None] Provisioning complete for port 32714a80-7bbc-4667-b4b7-e4274ceab763 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:05.555641 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-65fa0973-5861-48af-ab86-193b3949bf18 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:05.572300 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Set router 9a650133-6433-44b6-9741-b3bd050216ae gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:29:06.092600 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd84250>, [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:03Z', 'revision_number': 3, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:06.098987 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Checking router: 9a650133-6433-44b6-9741-b3bd050216ae for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:29:06.099738 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Updating router 9a650133-6433-44b6-9741-b3bd050216ae port 0137aec9-4829-4ec4-ac35-42db2874bf00 binding host dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:29:06.202880 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:06.280986 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 32714a80-7bbc-4667-b4b7-e4274ceab763 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:06.298570 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58d8d2ae-f2b9-47fa-afc3-c7e739c70791 req-2f994613-018d-4854-97f1-1e5c1743944c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:06.306027 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-58d8d2ae-f2b9-47fa-afc3-c7e739c70791 req-2f994613-018d-4854-97f1-1e5c1743944c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2807736
May 27 09:29:06.419131 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-58d8d2ae-f2b9-47fa-afc3-c7e739c70791 req-39dd8339-edeb-4ae5-a24c-b2e833425059 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1063101
May 27 09:29:06.538969 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 32714a80-7bbc-4667-b4b7-e4274ceab763 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:06.539747 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:06.628611 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8ab5f96-1da1-42f7-a3ab-2e502f39a47e req-d589ffd0-7473-44d5-b6a6-98777a2420f6 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:06.638887 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f8ab5f96-1da1-42f7-a3ab-2e502f39a47e req-d589ffd0-7473-44d5-b6a6-98777a2420f6 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 946 time: 0.1931884
May 27 09:29:06.739911 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f8ab5f96-1da1-42f7-a3ab-2e502f39a47e req-e541c701-64f5-4c1c-9aaf-305b6d9921a5 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0974438
May 27 09:29:06.894717 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Notify callbacks [] for port, precommit_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:06.936872 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.provisioning_blocks [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Transition to ACTIVE for port object 0137aec9-4829-4ec4-ac35-42db2874bf00 will not be triggered until provisioned by entity L2. {{(pid=91823) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:29:06.947808 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:06.968281 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:07.091348 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:07.131063 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Attempting to bind port 0137aec9-4829-4ec4-ac35-42db2874bf00 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:29:07.131985 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Attempting to bind port 0137aec9-4829-4ec4-ac35-42db2874bf00 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:29:07.132687 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Attempting to bind port 0137aec9-4829-4ec4-ac35-42db2874bf00 on network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:29:07.154598 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 28, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:29:07.155863 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Checking segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91823) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:29:07.156879 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:07.158245 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Bound using segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:29:07.159446 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Bound port: 0137aec9-4829-4ec4-ac35-42db2874bf00, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:29:07.162800 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:07.226745 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Pushing event updated for resources: {'Port': ['ID=0137aec9-4829-4ec4-ac35-42db2874bf00,revision_number=2']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:07.279905 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.280817 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.281587 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.282319 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.283066 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.283832 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.284567 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.285370 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.287177 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.288019 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.288660 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.289391 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:07.298442 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.330s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:07.399742 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] For port 0137aec9-4829-4ec4-ac35-42db2874bf00, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91823) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:29:07.408673 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] For port 0137aec9-4829-4ec4-ac35-42db2874bf00, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=0137aec9-4829-4ec4-ac35-42db2874bf00,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91823) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:29:07.415679 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:07.420780 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-873818d7-c976-4f0d-9786-94059ebcc2c7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:07.518214 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Pushing event updated for resources: {'Port': ['ID=0137aec9-4829-4ec4-ac35-42db2874bf00,revision_number=3']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:07.524983 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:07.556919 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Routers {'9a650133-6433-44b6-9741-b3bd050216ae'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:29:07.557703 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd84250>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:28:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['9a650133-6433-44b6-9741-b3bd050216ae'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:07.665764 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Allocated IP 172.20.0.1 (1f49b134-af0c-46a8-b862-f6cb6b6a0bba/6659533b-b3b0-4d3c-8bf0-709a19b7728d/c03df627-c904-49cf-8192-55ef32975e9a) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:29:07.959307 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] Set router 9a650133-6433-44b6-9741-b3bd050216ae gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:29:07.965846 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de7e96b3-b679-4696-bb96-106df92e4d52 req-9d9b10e7-224d-495e-b9e2-8d7cc0003f85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:07.969270 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-de7e96b3-b679-4696-bb96-106df92e4d52 req-9d9b10e7-224d-495e-b9e2-8d7cc0003f85 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 1098 time: 0.4572375
May 27 09:29:07.982795 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:08.001618 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Transition to ACTIVE for port object c03df627-c904-49cf-8192-55ef32975e9a will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:29:08.016730 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a80d81d6-4933-43e8-a1dc-c8f64b33ce55 req-87e14881-593f-4b8f-88b6-b2e50a25c86b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:08.018310 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a80d81d6-4933-43e8-a1dc-c8f64b33ce55 req-87e14881-593f-4b8f-88b6-b2e50a25c86b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2947774
May 27 09:29:08.071388 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:08.087866 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:08.141902 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a80d81d6-4933-43e8-a1dc-c8f64b33ce55 req-f17e70a7-66df-4af2-a608-532f16b4f827 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1005621
May 27 09:29:08.257222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:29:08.269304 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:29:08.290730 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:29:08.427056 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3816556'] for router_interface, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:08.463067 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Pushing event updated for resources: {'Port': ['ID=c03df627-c904-49cf-8192-55ef32975e9a,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:08.470561 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.382s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:08.509053 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd84250>, [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:03Z', 'revision_number': 3, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:08.515675 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-798618c1-03a8-4d03-bf7d-1d91b0d69f56 None None] The sync data for ids ['9a650133-6433-44b6-9741-b3bd050216ae'] in dv-cinder-772623-6-iscsi is: [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:03Z', 'revision_number': 3, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:29:08.523167 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-417f7589-bc01-4fab-8481-7c2f62ebbcd0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:08.624940 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:08.625247 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-ab78457b-6dbf-422f-bf2b-70f2ae58c87a None None] Provisioning for port c03df627-c904-49cf-8192-55ef32975e9a completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:29:08.634314 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-ab78457b-6dbf-422f-bf2b-70f2ae58c87a None None] Provisioning complete for port c03df627-c904-49cf-8192-55ef32975e9a triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:08.635031 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ab78457b-6dbf-422f-bf2b-70f2ae58c87a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:08.725318 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-ab78457b-6dbf-422f-bf2b-70f2ae58c87a None None] Port c03df627-c904-49cf-8192-55ef32975e9a cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:29:08.969204 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:08.976888 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:09.007245 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b9cbcf75-bd7d-4340-a67e-134893f69330 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:09.099843 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Pushing event updated for resources: {'Port': ['ID=c03df627-c904-49cf-8192-55ef32975e9a,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:09.102504 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3683833', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3816655'] for router_interface, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:09.106821 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:09.294074 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:29:09.295611 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:29:09.541007 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Router 9a650133-6433-44b6-9741-b3bd050216ae has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:29:09.667258 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-e44ecca1-b0fa-4476-99fa-884a7d022d50 None None] Provisioning complete for port c03df627-c904-49cf-8192-55ef32975e9a triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:09.668848 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e44ecca1-b0fa-4476-99fa-884a7d022d50 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:09.780386 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-e44ecca1-b0fa-4476-99fa-884a7d022d50 None None] Port c03df627-c904-49cf-8192-55ef32975e9a cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:29:09.874441 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:29:09.887099 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] 10.222.0.30 "PUT /v2.0/routers/9a650133-6433-44b6-9741-b3bd050216ae/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.7969642
May 27 09:29:09.924195 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-de7e96b3-b679-4696-bb96-106df92e4d52 req-c9ff76e7-7da0-4289-92cd-a0272d64f7b5 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0492320
May 27 09:29:10.194183 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 0137aec9-4829-4ec4-ac35-42db2874bf00 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:10.311987 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 0137aec9-4829-4ec4-ac35-42db2874bf00 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:29:10.319772 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 0137aec9-4829-4ec4-ac35-42db2874bf00 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:10.320371 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:10.501843 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Sync routers for ids ['9a650133-6433-44b6-9741-b3bd050216ae'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:29:10.556527 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Routers {'9a650133-6433-44b6-9741-b3bd050216ae'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:29:10.557860 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed192e50>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:28:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['9a650133-6433-44b6-9741-b3bd050216ae'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:10.649091 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:10.695868 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 0137aec9-4829-4ec4-ac35-42db2874bf00, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=0137aec9-4829-4ec4-ac35-42db2874bf00,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:29:10.747781 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:10.758334 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-67ccab34-a1d5-4d99-8924-f49f184f4470 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:10.851978 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49710) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:10.861205 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-710346399-network', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:10.870350 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:10.876632 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Usage tracker for resource:network and tenant:8fa04a9552394b50b0cef7e35b83a87c is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:10.881393 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:10.892553 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:10.920259 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Made reservation on behalf of 8fa04a9552394b50b0cef7e35b83a87c for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:29:10.930168 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:10.930518 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=0137aec9-4829-4ec4-ac35-42db2874bf00,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:10.947462 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:10.950479 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Set router 9a650133-6433-44b6-9741-b3bd050216ae gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:29:10.963334 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:10.967632 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Usage tracker for resource:security_group_rule and tenant:8fa04a9552394b50b0cef7e35b83a87c is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:10.971022 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:10.978628 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:11.022417 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.022960 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.023468 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.023944 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.024440 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.026744 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.027134 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.027664 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.028202 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.028648 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.029125 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.029581 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:29:11.047205 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:11.096513 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:11.103458 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:11.112119 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1368e84b-6539-4767-bbce-f9f0778eb9ed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:11.172886 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] vlan segment allocate from pool success with {'vlan_id': 398, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:29:11.193101 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d48c16a8-4840-462e-9f36-2e686d08026c,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:11.211073 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.099s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:11.225379 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:11.227895 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Added segment fb3bb56f-e851-4dc9-a059-75ed93004f61 of type vlan for network 93808fcf-da41-473a-b8e5-03797225e7ce
May 27 09:29:11.266782 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:11.281421 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d406da18-5cef-4052-bd20-8f79fd7d86c3 req-38db112f-7a66-4808-a5d9-9ee355215fbf tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:11.289335 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d406da18-5cef-4052-bd20-8f79fd7d86c3 req-38db112f-7a66-4808-a5d9-9ee355215fbf tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.0977550
May 27 09:29:11.308171 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:11.313397 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:11.313742 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:11.325228 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c50a5adf-e636-473c-bd97-47641f7ad393 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:11.346381 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d406da18-5cef-4052-bd20-8f79fd7d86c3 req-2f7f791b-64dd-43b2-ad16-b7f3c711b887 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0560277
May 27 09:29:11.433335 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 881 time: 0.5799584
May 27 09:29:11.436762 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 49718) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:11.438033 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Pushing event updated for resources: {'Network': ['ID=93808fcf-da41-473a-b8e5-03797225e7ce,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:11.441189 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:11.443276 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Request body: {'subnet': {'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-710346399-subnet', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'ip_version': 4}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:11.448581 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:11.453183 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Usage tracker for resource:subnet and tenant:8fa04a9552394b50b0cef7e35b83a87c is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:11.456460 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:11.462456 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 93808fcf-da41-473a-b8e5-03797225e7ce details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:29:11.462700 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:11.474174 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Made reservation on behalf of 8fa04a9552394b50b0cef7e35b83a87c for: {'subnet': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:29:11.477354 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2399631'] for subnet, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:11.557659 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:11.595857 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed192e50>, [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:08Z', 'revision_number': 4, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:07Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c03df627-c904-49cf-8192-55ef32975e9a', 'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'mac_address': 'fa:16:3e:ca:67:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:07Z', 'updated_at': '2021-05-27T09:29:08Z', 'revision_number': 2, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'subnets': [{'id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:11.602182 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Checking router: 9a650133-6433-44b6-9741-b3bd050216ae for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:29:11.602826 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Updating router 9a650133-6433-44b6-9741-b3bd050216ae port c03df627-c904-49cf-8192-55ef32975e9a binding host dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:29:11.679988 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:11.833223 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a2cf789c-6484-472a-bc19-20ca9da7a850 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:12.242532 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 0137aec9-4829-4ec4-ac35-42db2874bf00 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:12.259886 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2157992', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2399641'] for subnet, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:12.268607 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:12.375802 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Pushing event updated for resources: {'Subnet': ['ID=c6ee1048-84dd-4c7a-bd51-e1a97abf20e5,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:12.380750 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:12.383944 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Checking segment: {'id': 'fb3bb56f-e851-4dc9-a059-75ed93004f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:29:12.384417 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Network hostable DHCP agents. Network: 93808fcf-da41-473a-b8e5-03797225e7ce, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91821) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:29:12.402246 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Notify callbacks [] for port, precommit_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:12.406734 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Network 93808fcf-da41-473a-b8e5-03797225e7ce is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91821) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:29:12.408478 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:12.420409 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 93808fcf-da41-473a-b8e5-03797225e7ce) {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:29:12.435180 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4f96b71-5336-4ed5-b54a-ccefcd8b2b33 None None] Network 93808fcf-da41-473a-b8e5-03797225e7ce requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:29:12.443048 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:12.444496 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:12.462605 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Transition to ACTIVE for port object c03df627-c904-49cf-8192-55ef32975e9a will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:29:12.481482 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 844 time: 1.0432026
May 27 09:29:12.484569 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 49738) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:12.493135 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-710346399-router', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:12.501361 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:12.509321 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Usage tracker for resource:router and tenant:8fa04a9552394b50b0cef7e35b83a87c is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:12.514845 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:12.526701 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:12.546148 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3812772', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1963'] for router, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:12.548263 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3855012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3811180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3881146', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1952'] for router, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:12.569552 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:12.573414 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:12.589755 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:12.652041 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 0137aec9-4829-4ec4-ac35-42db2874bf00 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:12.652448 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:12.805441 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6cc52e7-ee28-460c-84f3-b1c7d85e8e17 None None] Pushing event updated for resources: {'Port': ['ID=c03df627-c904-49cf-8192-55ef32975e9a,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:12.834908 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-b6cc52e7-ee28-460c-84f3-b1c7d85e8e17 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.261s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:13.018173 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Attempting to bind port c03df627-c904-49cf-8192-55ef32975e9a on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:29:13.018459 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Attempting to bind port c03df627-c904-49cf-8192-55ef32975e9a by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:29:13.018771 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Attempting to bind port c03df627-c904-49cf-8192-55ef32975e9a on network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:29:13.078404 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3811195', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3812794', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2006'] for router, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:13.078696 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 29, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:29:13.078915 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Checking segment: {'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:29:13.079325 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:13.079625 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Bound using segment: {'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:29:13.080087 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Bound port: c03df627-c904-49cf-8192-55ef32975e9a, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:29:13.080468 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:13.166972 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp391d76a4-97d4-5c01-84fd-9bc405269bae-93808fcf-da41-473a-b8e5-03797225e7ce', 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'fixed_ips': [{'subnet_id': 'c6ee1048-84dd-4c7a-bd51-e1a97abf20e5'}]}} from dv-cinder-772623-6-iscsi. {{(pid=91822) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 27 09:29:13.167847 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:13.392772 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] For port c03df627-c904-49cf-8192-55ef32975e9a, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:29:13.433180 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] For port c03df627-c904-49cf-8192-55ef32975e9a, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=c03df627-c904-49cf-8192-55ef32975e9a,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:29:13.446394 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:13.482491 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:13.513955 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:13.576802 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:13.634300 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.db_base_plugin_common [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Allocated IP 172.20.0.2 (93808fcf-da41-473a-b8e5-03797225e7ce/c6ee1048-84dd-4c7a-bd51-e1a97abf20e5/bae10c78-85a6-404c-bdbc-073e28e2353f) {{(pid=91822) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:29:13.648007 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Routers {'9a650133-6433-44b6-9741-b3bd050216ae'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:29:13.648670 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed192e50>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:29:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['9a650133-6433-44b6-9741-b3bd050216ae'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:13.724730 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6cc52e7-ee28-460c-84f3-b1c7d85e8e17 None None] Pushing event updated for resources: {'Port': ['ID=c03df627-c904-49cf-8192-55ef32975e9a,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:13.739284 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-b6cc52e7-ee28-460c-84f3-b1c7d85e8e17 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.257s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:13.820024 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Allocated IP 172.27.1.50 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/810b9568-53a3-46b7-a25b-7d6c73eee345) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:29:14.038261 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] Set router 9a650133-6433-44b6-9741-b3bd050216ae gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:29:14.041674 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:14.084703 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:14.089122 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:14.170742 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:29:14.174058 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:29:14.178991 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:29:14.215938 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Pushing event updated for resources: {'Port': ['ID=810b9568-53a3-46b7-a25b-7d6c73eee345,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:14.225509 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:14.347489 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Notify callbacks [] for port, precommit_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:14.385470 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Transition to ACTIVE for port object bae10c78-85a6-404c-bdbc-073e28e2353f will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:29:14.457524 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Transition to ACTIVE for port object bae10c78-85a6-404c-bdbc-073e28e2353f will not be triggered until provisioned by entity DHCP. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:29:14.486424 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:14.498444 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:14.637270 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Network 93808fcf-da41-473a-b8e5-03797225e7ce is already hosted by enough agents. {{(pid=91822) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:29:14.641922 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.base_scheduler [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Resources bound (agent type, host, resource id):  {{(pid=91822) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:29:14.649118 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Received port after_create {{(pid=91822) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:29:14.663121 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Pushing event updated for resources: {'Port': ['ID=bae10c78-85a6-404c-bdbc-073e28e2353f,revision_number=1']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:14.668196 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:14.766771 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Attempting to bind port bae10c78-85a6-404c-bdbc-073e28e2353f on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:29:14.767149 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Attempting to bind port bae10c78-85a6-404c-bdbc-073e28e2353f by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'fb3bb56f-e851-4dc9-a059-75ed93004f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:29:14.767551 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Attempting to bind port bae10c78-85a6-404c-bdbc-073e28e2353f on network 93808fcf-da41-473a-b8e5-03797225e7ce {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:29:14.776979 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 29, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:29:14.777361 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Checking segment: {'id': 'fb3bb56f-e851-4dc9-a059-75ed93004f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:29:14.777790 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:14.778187 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Bound using segment: {'id': 'fb3bb56f-e851-4dc9-a059-75ed93004f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:29:14.778678 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Bound port: bae10c78-85a6-404c-bdbc-073e28e2353f, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb3bb56f-e851-4dc9-a059-75ed93004f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:29:14.779054 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:14.798652 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed192e50>, [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:08Z', 'revision_number': 4, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c03df627-c904-49cf-8192-55ef32975e9a', 'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'mac_address': 'fa:16:3e:ca:67:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:07Z', 'updated_at': '2021-05-27T09:29:13Z', 'revision_number': 4, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'subnets': [{'id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:14.827537 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d95e5051-3ea1-4892-82c0-5179008de261 req-1d4a9b57-6748-4654-8fcf-0b44b70aa4c5 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:14.829129 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d95e5051-3ea1-4892-82c0-5179008de261 req-1d4a9b57-6748-4654-8fcf-0b44b70aa4c5 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2829070
May 27 09:29:14.833858 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bd7c193-7192-4b1a-ac80-24f5c4349358 None None] The sync data for ids ['9a650133-6433-44b6-9741-b3bd050216ae'] in dv-cinder-772623-6-iscsi is: [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:08Z', 'revision_number': 4, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c03df627-c904-49cf-8192-55ef32975e9a', 'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'mac_address': 'fa:16:3e:ca:67:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:07Z', 'updated_at': '2021-05-27T09:29:13Z', 'revision_number': 4, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'subnets': [{'id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:29:14.872139 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:14.918282 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] For port bae10c78-85a6-404c-bdbc-073e28e2353f, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:29:14.971956 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] For port bae10c78-85a6-404c-bdbc-073e28e2353f, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=bae10c78-85a6-404c-bdbc-073e28e2353f,segment=NetworkSegment(fb3bb56f-e851-4dc9-a059-75ed93004f61),segment_id=fb3bb56f-e851-4dc9-a059-75ed93004f61)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:29:14.991819 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:15.009129 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-a99fb8d2-faea-4876-b657-e23405e7822a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:15.074372 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:15.110603 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Pushing event updated for resources: {'Port': ['ID=bae10c78-85a6-404c-bdbc-073e28e2353f,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:15.122705 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:15.149580 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d95e5051-3ea1-4892-82c0-5179008de261 req-16be2777-388b-41c2-9aa0-23c977378c2b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3079431
May 27 09:29:15.788354 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3812787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3811082'] for router, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:16.132747 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Router 661f4e35-828e-4be3-8181-3d1a1d92c170 is scheduled to L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 with binding_index 1 {{(pid=91821) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 27 09:29:16.336043 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device bae10c78-85a6-404c-bdbc-073e28e2353f up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:16.454842 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port bae10c78-85a6-404c-bdbc-073e28e2353f completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:29:16.470506 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device c03df627-c904-49cf-8192-55ef32975e9a up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:16.627824 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:29:16.644084 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Sync routers for ids ['661f4e35-828e-4be3-8181-3d1a1d92c170'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:29:16.663025 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Routers {'661f4e35-828e-4be3-8181-3d1a1d92c170'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:29:16.665970 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecf35100>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:29:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['661f4e35-828e-4be3-8181-3d1a1d92c170'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:16.666766 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port c03df627-c904-49cf-8192-55ef32975e9a completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:29:16.670099 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9efe627e-cab8-4504-acbd-fe4a183c0ccd req-9691f3a8-2fed-4219-a00d-a880f872df48 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:16.680583 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9efe627e-cab8-4504-acbd-fe4a183c0ccd req-9691f3a8-2fed-4219-a00d-a880f872df48 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1860406
May 27 09:29:16.688237 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port c03df627-c904-49cf-8192-55ef32975e9a triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:16.688713 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:16.730159 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d82d552f-dfd9-4f69-888d-0a65bbc0ef03 None None] Network 93808fcf-da41-473a-b8e5-03797225e7ce requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:29:16.887131 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Notify callbacks [] for router, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:16.893331 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201  len: 919 time: 4.4073145
May 27 09:29:16.893623 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49796) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:16.926404 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9efe627e-cab8-4504-acbd-fe4a183c0ccd req-f02e8288-06b1-485d-898f-b6035436233b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2446771
May 27 09:29:17.010142 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Set router 661f4e35-828e-4be3-8181-3d1a1d92c170 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:29:17.076190 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-e99b9186-70e0-461b-86fa-aa194a5b31f1 None None] Provisioning for port bae10c78-85a6-404c-bdbc-073e28e2353f completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:29:17.151538 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-e99b9186-70e0-461b-86fa-aa194a5b31f1 None None] Provisioning complete for port bae10c78-85a6-404c-bdbc-073e28e2353f triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:17.152133 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e99b9186-70e0-461b-86fa-aa194a5b31f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:17.329486 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecf35100>, [{'id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'name': 'tempest-TestShelveInstance-710346399-router', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:12Z', 'updated_at': '2021-05-27T09:29:14Z', 'revision_number': 3, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'gw_port': {'id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:04:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_gateway', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:13Z', 'updated_at': '2021-05-27T09:29:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:17.334536 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Checking router: 661f4e35-828e-4be3-8181-3d1a1d92c170 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:29:17.335163 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Updating router 661f4e35-828e-4be3-8181-3d1a1d92c170 port 810b9568-53a3-46b7-a25b-7d6c73eee345 binding host dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:29:17.405937 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:17.465113 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:17.596654 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port c03df627-c904-49cf-8192-55ef32975e9a, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=c03df627-c904-49cf-8192-55ef32975e9a,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:29:17.615474 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:17.621112 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:17.694527 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e99b9186-70e0-461b-86fa-aa194a5b31f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:17.747538 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=c03df627-c904-49cf-8192-55ef32975e9a,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:17.750849 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:17.766141 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-e99b9186-70e0-461b-86fa-aa194a5b31f1 None None] For port bae10c78-85a6-404c-bdbc-073e28e2353f, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=bae10c78-85a6-404c-bdbc-073e28e2353f,segment=NetworkSegment(fb3bb56f-e851-4dc9-a059-75ed93004f61),segment_id=fb3bb56f-e851-4dc9-a059-75ed93004f61)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:29:17.777855 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e99b9186-70e0-461b-86fa-aa194a5b31f1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:17.782754 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:17.787913 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Notify callbacks [] for port, precommit_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:17.802796 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.provisioning_blocks [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Transition to ACTIVE for port object 810b9568-53a3-46b7-a25b-7d6c73eee345 will not be triggered until provisioned by entity L2. {{(pid=91823) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:29:17.817622 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:17.827225 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-0ac37633-809a-4b9c-ad5a-cf5c6ea2e47e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:17.849132 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:17.908470 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a4d28f2-b6aa-4415-b952-5c3a27d1f992 None None] Pushing event updated for resources: {'Port': ['ID=810b9568-53a3-46b7-a25b-7d6c73eee345,revision_number=2']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:17.913083 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-4a4d28f2-b6aa-4415-b952-5c3a27d1f992 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:17.933367 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Attempting to bind port 810b9568-53a3-46b7-a25b-7d6c73eee345 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:29:17.933982 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Attempting to bind port 810b9568-53a3-46b7-a25b-7d6c73eee345 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:29:17.934358 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Attempting to bind port 810b9568-53a3-46b7-a25b-7d6c73eee345 on network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:29:17.937691 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e99b9186-70e0-461b-86fa-aa194a5b31f1 None None] Pushing event updated for resources: {'Port': ['ID=bae10c78-85a6-404c-bdbc-073e28e2353f,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:17.943852 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 29, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:29:17.944235 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Checking segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91823) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:29:17.944652 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:17.945056 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Bound using segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:29:17.945701 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-e99b9186-70e0-461b-86fa-aa194a5b31f1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:17.945842 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Bound port: 810b9568-53a3-46b7-a25b-7d6c73eee345, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:29:17.945980 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:18.081657 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] For port 810b9568-53a3-46b7-a25b-7d6c73eee345, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91823) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:29:18.087219 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] For port 810b9568-53a3-46b7-a25b-7d6c73eee345, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=810b9568-53a3-46b7-a25b-7d6c73eee345,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91823) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:29:18.102135 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:18.104786 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-a4dbd5a0-836f-4c55-8601-955bb32b42fd None None] Provisioning complete for port bae10c78-85a6-404c-bdbc-073e28e2353f triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:18.105174 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a4dbd5a0-836f-4c55-8601-955bb32b42fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:18.112063 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-4a4d28f2-b6aa-4415-b952-5c3a27d1f992 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:18.169053 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Allocated IP 172.20.0.1 (93808fcf-da41-473a-b8e5-03797225e7ce/c6ee1048-84dd-4c7a-bd51-e1a97abf20e5/4da93041-8802-409a-a1ac-d2b7a1501378) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:29:18.213908 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device bae10c78-85a6-404c-bdbc-073e28e2353f up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:18.267703 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Routers {'661f4e35-828e-4be3-8181-3d1a1d92c170'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:29:18.268755 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecf35100>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:29:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['661f4e35-828e-4be3-8181-3d1a1d92c170'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:18.392394 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a4d28f2-b6aa-4415-b952-5c3a27d1f992 None None] Pushing event updated for resources: {'Port': ['ID=810b9568-53a3-46b7-a25b-7d6c73eee345,revision_number=3']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:18.421132 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-4a4d28f2-b6aa-4415-b952-5c3a27d1f992 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.307s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:18.426867 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port bae10c78-85a6-404c-bdbc-073e28e2353f triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:18.427805 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:18.456582 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:18.499529 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Transition to ACTIVE for port object 4da93041-8802-409a-a1ac-d2b7a1501378 will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:29:18.548965 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:18.554806 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:18.641777 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device c03df627-c904-49cf-8192-55ef32975e9a up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:18.649073 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Network 93808fcf-da41-473a-b8e5-03797225e7ce is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:29:18.655750 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:29:18.656757 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] Set router 661f4e35-828e-4be3-8181-3d1a1d92c170 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:29:18.660709 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:29:18.711741 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Pushing event updated for resources: {'Port': ['ID=4da93041-8802-409a-a1ac-d2b7a1501378,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:18.719306 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:18.753462 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3816556'] for router_interface, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:18.807405 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port c03df627-c904-49cf-8192-55ef32975e9a triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:18.807946 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:19.044374 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-0dfde906-1b05-4f28-bb8d-82cf6afb6aa4 None None] Provisioning for port 4da93041-8802-409a-a1ac-d2b7a1501378 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:29:19.051037 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-0dfde906-1b05-4f28-bb8d-82cf6afb6aa4 None None] Provisioning complete for port 4da93041-8802-409a-a1ac-d2b7a1501378 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:19.051584 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-0dfde906-1b05-4f28-bb8d-82cf6afb6aa4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:19.075144 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:19.130071 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-0dfde906-1b05-4f28-bb8d-82cf6afb6aa4 None None] Port 4da93041-8802-409a-a1ac-d2b7a1501378 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:29:19.198590 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecf35100>, [{'id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'name': 'tempest-TestShelveInstance-710346399-router', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:12Z', 'updated_at': '2021-05-27T09:29:14Z', 'revision_number': 3, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'gw_port': {'id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:04:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_gateway', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:13Z', 'updated_at': '2021-05-27T09:29:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:19.202930 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9da2c023-f748-41de-8acc-65344b170cb7 None None] The sync data for ids ['661f4e35-828e-4be3-8181-3d1a1d92c170'] in dv-cinder-772623-6-iscsi is: [{'id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'name': 'tempest-TestShelveInstance-710346399-router', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:12Z', 'updated_at': '2021-05-27T09:29:14Z', 'revision_number': 3, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'gw_port': {'id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:04:44', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_gateway', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:13Z', 'updated_at': '2021-05-27T09:29:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:29:19.332543 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:19.338541 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:19.390972 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-65f5d8fe-aa4e-4c52-b883-752eededda61 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:19.568735 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3683833', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3816655'] for router_interface, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:19.578236 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Pushing event updated for resources: {'Port': ['ID=4da93041-8802-409a-a1ac-d2b7a1501378,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:19.583674 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:19.835944 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Network 93808fcf-da41-473a-b8e5-03797225e7ce is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:29:19.838273 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:29:20.204317 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-493d92f8-30ab-45dd-85c5-a369665cb8db None None] Provisioning complete for port 4da93041-8802-409a-a1ac-d2b7a1501378 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:20.205669 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-493d92f8-30ab-45dd-85c5-a369665cb8db None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:20.362490 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-493d92f8-30ab-45dd-85c5-a369665cb8db None None] Port 4da93041-8802-409a-a1ac-d2b7a1501378 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:29:20.371898 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 810b9568-53a3-46b7-a25b-7d6c73eee345 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:20.474314 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7ca4d2d-c4f2-4b77-8447-504799d5348c req-0f795905-b4f1-478e-8a89-2849b826037e tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:20.489005 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e7ca4d2d-c4f2-4b77-8447-504799d5348c req-0f795905-b4f1-478e-8a89-2849b826037e tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1613996
May 27 09:29:20.506746 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Router 661f4e35-828e-4be3-8181-3d1a1d92c170 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:29:20.585384 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e7ca4d2d-c4f2-4b77-8447-504799d5348c req-12e1a3e4-5e16-4558-8854-1923035fcd4f tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0944500
May 27 09:29:20.657985 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 810b9568-53a3-46b7-a25b-7d6c73eee345 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:29:20.681312 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 810b9568-53a3-46b7-a25b-7d6c73eee345 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:20.682225 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:20.944405 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:20.978859 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 810b9568-53a3-46b7-a25b-7d6c73eee345, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=810b9568-53a3-46b7-a25b-7d6c73eee345,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:29:20.985758 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:20.988742 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:21.051071 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:29:21.086445 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] 10.222.0.30 "PUT /v2.0/routers/661f4e35-828e-4be3-8181-3d1a1d92c170/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.1913469
May 27 09:29:21.119544 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=810b9568-53a3-46b7-a25b-7d6c73eee345,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:21.125535 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:21.825870 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Sync routers for ids ['661f4e35-828e-4be3-8181-3d1a1d92c170'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:29:21.840282 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Routers {'661f4e35-828e-4be3-8181-3d1a1d92c170'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:29:21.841424 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecaca640>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:29:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['661f4e35-828e-4be3-8181-3d1a1d92c170'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:22.059620 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9c1fa6d8-3683-4c40-8be8-470c66abe8cb req-a9d22005-9fe2-4a34-8b5a-973a1b1c759c service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1340499
May 27 09:29:22.116261 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Set router 661f4e35-828e-4be3-8181-3d1a1d92c170 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:29:22.178598 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 810b9568-53a3-46b7-a25b-7d6c73eee345 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:22.289323 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1fa6d8-3683-4c40-8be8-470c66abe8cb req-992f657c-899c-4b34-8ade-8d8dfcdc6e08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:22.295684 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9c1fa6d8-3683-4c40-8be8-470c66abe8cb req-992f657c-899c-4b34-8ade-8d8dfcdc6e08 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 1098 time: 0.1893182
May 27 09:29:22.304596 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 810b9568-53a3-46b7-a25b-7d6c73eee345 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:22.304981 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:22.398141 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49882) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:22.412541 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1870673697', 'description': 'tempest-secgroup-smoke-1870673697 description', 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:22.423562 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:22.432920 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Usage tracker for resource:security_group and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:22.441911 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:22.458788 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:22.482535 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:22.544893 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:22.556680 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Usage tracker for resource:security_group_rule and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:22.564187 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:22.579637 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:22.712547 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:22.720090 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:22.728295 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-90b118fb-f874-4f1f-8452-ace1f1bd4896 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:22.785328 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:22.788936 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:22.790697 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.3899643
May 27 09:29:22.792213 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:22.795553 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49886) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:22.804969 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c2c8f-2cda-4331-ba72-b49f4c7550dd', 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:22.816737 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:22.826080 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Usage tracker for resource:security_group_rule and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:22.831647 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:22.832622 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecaca640>, [{'id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'name': 'tempest-TestShelveInstance-710346399-router', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:12Z', 'updated_at': '2021-05-27T09:29:18Z', 'revision_number': 4, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'gw_port': {'id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:04:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_gateway', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:13Z', 'updated_at': '2021-05-27T09:29:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '4da93041-8802-409a-a1ac-d2b7a1501378', 'name': '', 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'mac_address': 'fa:16:3e:c8:2d:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_interface', 'standard_attr_id': 288, 'fixed_ips': [{'subnet_id': 'c6ee1048-84dd-4c7a-bd51-e1a97abf20e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:17Z', 'updated_at': '2021-05-27T09:29:19Z', 'revision_number': 2, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'subnets': [{'id': 'c6ee1048-84dd-4c7a-bd51-e1a97abf20e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:22.839565 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Checking router: 661f4e35-828e-4be3-8181-3d1a1d92c170 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:29:22.840136 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:22.840635 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Updating router 661f4e35-828e-4be3-8181-3d1a1d92c170 port 4da93041-8802-409a-a1ac-d2b7a1501378 binding host dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:29:22.874378 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:22.888792 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1fa6d8-3683-4c40-8be8-470c66abe8cb req-e4002e6d-9fd4-468a-97da-aa83e8de9268 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:22.892011 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9c1fa6d8-3683-4c40-8be8-470c66abe8cb req-e4002e6d-9fd4-468a-97da-aa83e8de9268 service neutron] 10.222.0.11 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 920 time: 0.5568678
May 27 09:29:22.940125 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.013590 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9c1fa6d8-3683-4c40-8be8-470c66abe8cb req-61ba9d4d-e7d4-4f4d-868c-16ffa1e7dae5 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=61f95559-dc0a-4418-af09-fd9c84d973ac HTTP/1.1" status: 200  len: 217 time: 0.1120989
May 27 09:29:23.022745 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.030993 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.118413 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-485685da-e85b-461d-96de-6473ba0b25e9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:23.141664 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.153864 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3558245
May 27 09:29:23.168224 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49892) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:23.181871 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c2c8f-2cda-4331-ba72-b49f4c7550dd', 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:23.195089 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e5229095-a5bf-4346-9ed2-0a66b0edb179,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:23.198197 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:23.206422 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:23.209220 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Usage tracker for resource:security_group_rule and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:23.214928 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:23.229635 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c1fa6d8-3683-4c40-8be8-470c66abe8cb req-31e45cb6-7e01-4df9-82bd-4962004c8ca8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:23.233172 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9c1fa6d8-3683-4c40-8be8-470c66abe8cb req-31e45cb6-7e01-4df9-82bd-4962004c8ca8 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac HTTP/1.1" status: 200  len: 859 time: 0.2034354
May 27 09:29:23.237074 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:23.285313 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.352828 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9c1fa6d8-3683-4c40-8be8-470c66abe8cb req-18a0e0d8-bdb3-4fcd-8314-817ccbfc8ba6 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1097484
May 27 09:29:23.460738 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.466609 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.471635 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:23.527137 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9208fda2-fbc8-4e7c-8367-54904f0d3800,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:23.538713 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:23.587141 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.598699 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.4205875
May 27 09:29:23.600674 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49910) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:23.627595 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9c1fa6d8-3683-4c40-8be8-470c66abe8cb req-d1f64732-6c6e-488e-b39d-e71571d1d29d service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2631662
May 27 09:29:23.633622 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c2c8f-2cda-4331-ba72-b49f4c7550dd', 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:23.649483 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:23.664898 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Usage tracker for resource:security_group_rule and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:23.686796 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:23.723339 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:23.759842 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Notify callbacks [] for port, precommit_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.764439 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.790006 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Transition to ACTIVE for port object 4da93041-8802-409a-a1ac-d2b7a1501378 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:29:23.813591 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.821514 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-2f7a3837-946a-4ba6-b5e7-dcc58776184a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:23.931184 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.939830 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:23.943296 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:24.045634 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.052849 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4512911
May 27 09:29:24.058474 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49922) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:24.059213 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3ee8c235-a723-442c-98fe-67d202b204f7,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:24.061957 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9c1fa6d8-3683-4c40-8be8-470c66abe8cb req-306c8d61-798f-47d8-bc21-107dcd90bfc1 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4257650
May 27 09:29:24.065667 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:24.077838 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c2c8f-2cda-4331-ba72-b49f4c7550dd', 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:24.094371 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:29:24.104239 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:24.114398 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Usage tracker for resource:security_group_rule and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:24.121363 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:24.136765 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:24.260309 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f25ccf27-3734-4f4b-9441-fa9abd8b1310 None None] Pushing event updated for resources: {'Port': ['ID=4da93041-8802-409a-a1ac-d2b7a1501378,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:24.261239 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.267114 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-f25ccf27-3734-4f4b-9441-fa9abd8b1310 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.446s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:24.432133 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.434941 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Attempting to bind port 4da93041-8802-409a-a1ac-d2b7a1501378 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:29:24.435984 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Attempting to bind port 4da93041-8802-409a-a1ac-d2b7a1501378 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'fb3bb56f-e851-4dc9-a059-75ed93004f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:29:24.436697 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Attempting to bind port 4da93041-8802-409a-a1ac-d2b7a1501378 on network 93808fcf-da41-473a-b8e5-03797225e7ce {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:29:24.439467 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.443077 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:24.450937 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 29, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:29:24.452121 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Checking segment: {'id': 'fb3bb56f-e851-4dc9-a059-75ed93004f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:29:24.452910 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.454387 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Bound using segment: {'id': 'fb3bb56f-e851-4dc9-a059-75ed93004f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:29:24.455565 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Bound port: 4da93041-8802-409a-a1ac-d2b7a1501378, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fb3bb56f-e851-4dc9-a059-75ed93004f61', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:29:24.456538 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.477942 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ef3dc644-0422-480d-a43f-7b54566d881d,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:24.480804 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:24.490688 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.492933 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.4261205
May 27 09:29:24.497520 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49932) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:24.506175 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c2c8f-2cda-4331-ba72-b49f4c7550dd', 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:24.514146 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:24.521349 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Usage tracker for resource:security_group_rule and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:24.526777 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:24.534700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:24.551767 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.securitygroups_db [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Project a31154df1ce4420f9bdf53b8b3b3649e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 27 09:29:24.562563 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.661084 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.666741 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.671398 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-569b535d-d795-4d31-9156-6cfb0708429f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:24.687314 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] For port 4da93041-8802-409a-a1ac-d2b7a1501378, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:29:24.693666 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] For port 4da93041-8802-409a-a1ac-d2b7a1501378, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=4da93041-8802-409a-a1ac-d2b7a1501378,segment=NetworkSegment(fb3bb56f-e851-4dc9-a059-75ed93004f61),segment_id=fb3bb56f-e851-4dc9-a059-75ed93004f61)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:29:24.699824 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b81a7941-8767-4c11-aabf-85baf64f73e6 req-a0af0667-42a3-4222-819f-124ead686199 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:24.702642 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.706709 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:24.708992 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5d3de7eb-e09e-4e51-a565-2e164a1d0dde,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:24.713153 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b81a7941-8767-4c11-aabf-85baf64f73e6 req-a0af0667-42a3-4222-819f-124ead686199 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 1098 time: 0.3999183
May 27 09:29:24.722815 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:24.735551 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ec67a31-f853-47ad-b0e2-0c6e9558fb97 req-f68b73f5-ce85-44c1-bca8-2c84547223a6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:24.737721 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.741602 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.2422404
May 27 09:29:24.746687 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 49936) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:24.750130 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0ec67a31-f853-47ad-b0e2-0c6e9558fb97 req-f68b73f5-ce85-44c1-bca8-2c84547223a6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.3190761
May 27 09:29:24.756335 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Request body: {'security_group_rule': {'security_group_id': 'bb8c2c8f-2cda-4331-ba72-b49f4c7550dd', 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:24.770983 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:24.778970 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Usage tracker for resource:security_group_rule and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:24.785844 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:24.796967 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:24.825268 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.securitygroups_db [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Project a31154df1ce4420f9bdf53b8b3b3649e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 27 09:29:24.841280 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:24.859771 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Routers {'661f4e35-828e-4be3-8181-3d1a1d92c170'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:29:24.861646 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecaca640>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:29:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['661f4e35-828e-4be3-8181-3d1a1d92c170'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:24.961583 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0ec67a31-f853-47ad-b0e2-0c6e9558fb97 req-0448f0d1-1702-4a7e-99ab-3799071f1c80 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2103407
May 27 09:29:25.077687 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:25.091437 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:25.094522 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b81a7941-8767-4c11-aabf-85baf64f73e6 req-19388503-e956-4ba3-9734-6562ecf1be6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:25.099182 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b81a7941-8767-4c11-aabf-85baf64f73e6 req-19388503-e956-4ba3-9734-6562ecf1be6f service neutron] 10.222.0.11 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 920 time: 0.3460593
May 27 09:29:25.126605 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:25.166722 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7073bf4e-012b-4331-b665-c2a4be409de0,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:25.184640 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:25.206259 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f25ccf27-3734-4f4b-9441-fa9abd8b1310 None None] Pushing event updated for resources: {'Port': ['ID=4da93041-8802-409a-a1ac-d2b7a1501378,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:25.212360 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:25.222949 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-f25ccf27-3734-4f4b-9441-fa9abd8b1310 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.516s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:25.229325 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.4808779
May 27 09:29:25.380059 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b81a7941-8767-4c11-aabf-85baf64f73e6 req-db1f2b7e-31c3-4cf6-9873-d56434d66ca5 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=61f95559-dc0a-4418-af09-fd9c84d973ac HTTP/1.1" status: 200  len: 217 time: 0.2722948
May 27 09:29:25.532706 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] Set router 661f4e35-828e-4be3-8181-3d1a1d92c170 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:29:25.608075 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b81a7941-8767-4c11-aabf-85baf64f73e6 req-1856990e-4d5f-45a7-8601-c56420ae76b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:25.609923 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b81a7941-8767-4c11-aabf-85baf64f73e6 req-1856990e-4d5f-45a7-8601-c56420ae76b5 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac HTTP/1.1" status: 200  len: 859 time: 0.2035379
May 27 09:29:25.695130 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b81a7941-8767-4c11-aabf-85baf64f73e6 req-4a897b60-f87b-439e-9d5a-c01924dcaef4 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0673459
May 27 09:29:25.886675 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b81a7941-8767-4c11-aabf-85baf64f73e6 req-15e3d4a1-970a-443f-8ef8-13c8cc2d3498 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1756630
May 27 09:29:26.294406 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecaca640>, [{'id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'name': 'tempest-TestShelveInstance-710346399-router', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:12Z', 'updated_at': '2021-05-27T09:29:18Z', 'revision_number': 4, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'gw_port': {'id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:04:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_gateway', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:13Z', 'updated_at': '2021-05-27T09:29:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '4da93041-8802-409a-a1ac-d2b7a1501378', 'name': '', 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'mac_address': 'fa:16:3e:c8:2d:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_interface', 'standard_attr_id': 288, 'fixed_ips': [{'subnet_id': 'c6ee1048-84dd-4c7a-bd51-e1a97abf20e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:17Z', 'updated_at': '2021-05-27T09:29:24Z', 'revision_number': 4, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'subnets': [{'id': 'c6ee1048-84dd-4c7a-bd51-e1a97abf20e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:29:26.300412 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8b094e9-0532-4d68-bc43-83ab8404dc53 None None] The sync data for ids ['661f4e35-828e-4be3-8181-3d1a1d92c170'] in dv-cinder-772623-6-iscsi is: [{'id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'name': 'tempest-TestShelveInstance-710346399-router', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:12Z', 'updated_at': '2021-05-27T09:29:18Z', 'revision_number': 4, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'gw_port': {'id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:04:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_gateway', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:13Z', 'updated_at': '2021-05-27T09:29:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '4da93041-8802-409a-a1ac-d2b7a1501378', 'name': '', 'network_id': '93808fcf-da41-473a-b8e5-03797225e7ce', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'mac_address': 'fa:16:3e:c8:2d:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_interface', 'standard_attr_id': 288, 'fixed_ips': [{'subnet_id': 'c6ee1048-84dd-4c7a-bd51-e1a97abf20e5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:17Z', 'updated_at': '2021-05-27T09:29:24Z', 'revision_number': 4, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'subnets': [{'id': 'c6ee1048-84dd-4c7a-bd51-e1a97abf20e5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:29:26.398779 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:26.476978 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b81a7941-8767-4c11-aabf-85baf64f73e6 req-6a078dfe-b408-46d9-b9dd-e011acf9cdb8 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5825834
May 27 09:29:26.536058 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cafab792-0cd8-4c17-ad8c-6a449e9d7115 req-bff3aa2d-7dfe-40a8-b69c-4f124ca4117e tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:26.541037 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cafab792-0cd8-4c17-ad8c-6a449e9d7115 req-bff3aa2d-7dfe-40a8-b69c-4f124ca4117e tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.3378048
May 27 09:29:26.659235 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cafab792-0cd8-4c17-ad8c-6a449e9d7115 req-e5f3cc0d-061c-4f0b-8889-fcc5466abf74 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1117589
May 27 09:29:27.894905 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ca16e7f-949d-4103-a032-bc9412154603 req-2faf7a06-121d-479c-b248-9aacb6ece442 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:27.897724 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5ca16e7f-949d-4103-a032-bc9412154603 req-2faf7a06-121d-479c-b248-9aacb6ece442 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1126878
May 27 09:29:27.957688 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5ca16e7f-949d-4103-a032-bc9412154603 req-b261b275-8a7e-4ea1-89fb-7679eccabc3e tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0488904
May 27 09:29:28.178872 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 4da93041-8802-409a-a1ac-d2b7a1501378 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:28.251426 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 4da93041-8802-409a-a1ac-d2b7a1501378 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:29:28.256956 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 4da93041-8802-409a-a1ac-d2b7a1501378 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:28.257340 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:28.392777 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:28.436296 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 4da93041-8802-409a-a1ac-d2b7a1501378, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=4da93041-8802-409a-a1ac-d2b7a1501378,segment=NetworkSegment(fb3bb56f-e851-4dc9-a059-75ed93004f61),segment_id=fb3bb56f-e851-4dc9-a059-75ed93004f61)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:29:28.442164 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:28.444070 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-b6cc52e7-ee28-460c-84f3-b1c7d85e8e17 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:28.515394 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=4da93041-8802-409a-a1ac-d2b7a1501378,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:28.519493 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:29.192216 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd6ff5c8-3098-4a0f-bc2b-f8c6bf732490 req-2440006f-34d2-4596-b4bf-f1be83f7d7fe tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:29.193984 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cd6ff5c8-3098-4a0f-bc2b-f8c6bf732490 req-2440006f-34d2-4596-b4bf-f1be83f7d7fe tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1019111
May 27 09:29:29.263541 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cd6ff5c8-3098-4a0f-bc2b-f8c6bf732490 req-e82ec439-68db-45ab-840a-1c2dc9eec1c3 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0580976
May 27 09:29:30.149760 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 4da93041-8802-409a-a1ac-d2b7a1501378 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:29:30.272237 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 4da93041-8802-409a-a1ac-d2b7a1501378 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:29:30.272766 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:30.610980 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-680594a6-6a97-4fb7-96ad-ceb42747fe3f req-a54ee0a4-4be6-468c-80d1-19408dc0d241 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:30.614526 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-680594a6-6a97-4fb7-96ad-ceb42747fe3f req-a54ee0a4-4be6-468c-80d1-19408dc0d241 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1779826
May 27 09:29:30.670551 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-680594a6-6a97-4fb7-96ad-ceb42747fe3f req-c9ed35ea-5fd5-4f0a-aaed-61e9e5ca271b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0461144
May 27 09:29:31.910802 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbd8f8f8-f515-463a-ac42-69c034815f2f req-9f501180-4f67-4a8f-b4b2-aedfa4491656 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:31.912609 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cbd8f8f8-f515-463a-ac42-69c034815f2f req-9f501180-4f67-4a8f-b4b2-aedfa4491656 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1038291
May 27 09:29:31.975800 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cbd8f8f8-f515-463a-ac42-69c034815f2f req-092ee2c4-fa48-4c31-8c69-84c3664c4e26 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0558953
May 27 09:29:33.196930 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d2d0a35-6367-4591-ba4c-63f46574a94f req-a0503317-8dce-48e6-947f-f8e6af640a88 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:33.199078 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2d2d0a35-6367-4591-ba4c-63f46574a94f req-a0503317-8dce-48e6-947f-f8e6af640a88 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1118906
May 27 09:29:33.264741 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2d2d0a35-6367-4591-ba4c-63f46574a94f req-c7a3eaf1-d564-4367-a678-b5066d9a55be tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0548766
May 27 09:29:34.577471 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c3664b5-aed3-498c-a517-9f0822275716 req-073849a8-ab4f-4a18-a14f-e107803692d6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:34.585517 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1c3664b5-aed3-498c-a517-9f0822275716 req-073849a8-ab4f-4a18-a14f-e107803692d6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1795886
May 27 09:29:34.654674 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1c3664b5-aed3-498c-a517-9f0822275716 req-137a7a19-be34-4681-9fe4-37aab288b1a5 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0654597
May 27 09:29:35.919515 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cc9c79c-967b-4279-874b-9283ea268a27 req-42c88363-a24d-480f-be9c-f9c68a9fa121 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:35.923041 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0cc9c79c-967b-4279-874b-9283ea268a27 req-42c88363-a24d-480f-be9c-f9c68a9fa121 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1276319
May 27 09:29:36.010250 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0cc9c79c-967b-4279-874b-9283ea268a27 req-9660e8bb-986e-4dab-b9cb-118656fd799f tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0806963
May 27 09:29:37.313798 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2d135f-8753-40ad-9368-31336f3761a0 req-c3c09c38-f092-47c2-87b5-d14c3f7ed4cd tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:37.316184 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fc2d135f-8753-40ad-9368-31336f3761a0 req-c3c09c38-f092-47c2-87b5-d14c3f7ed4cd tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1516745
May 27 09:29:37.385792 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fc2d135f-8753-40ad-9368-31336f3761a0 req-6c65467e-9791-4363-bcc5-19a7d7aaa8a1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0545938
May 27 09:29:38.518770 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48d1d66c-9c79-49dc-873d-d567eb630dc0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:38.618844 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcebaf83-17ea-4c32-a217-3e2b4737d76b req-05b102ca-5cd7-4603-84ca-79009e38d254 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:38.620582 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dcebaf83-17ea-4c32-a217-3e2b4737d76b req-05b102ca-5cd7-4603-84ca-79009e38d254 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.0971956
May 27 09:29:38.697178 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dcebaf83-17ea-4c32-a217-3e2b4737d76b req-c1223085-de29-4232-9b62-ff6e9a4b3af8 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0616713
May 27 09:29:39.918813 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a2c29cc-e6a4-4bde-81fe-191af20602a5 req-7f1b3c9e-f37e-4f71-9770-cab18cf749d4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:39.927102 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1a2c29cc-e6a4-4bde-81fe-191af20602a5 req-7f1b3c9e-f37e-4f71-9770-cab18cf749d4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1026039
May 27 09:29:40.024914 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1a2c29cc-e6a4-4bde-81fe-191af20602a5 req-8d9911b4-0963-4936-abfb-677ff20ea9dd tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0952969
May 27 09:29:40.871409 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 50340) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:41.024672 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4d1e4e4f-9f1b-42fd-ad75-9d619c4bc6e0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:41.042616 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-4d1e4e4f-9f1b-42fd-ad75-9d619c4bc6e0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:41.047291 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-4d1e4e4f-9f1b-42fd-ad75-9d619c4bc6e0 admin admin] Usage tracker for resource:security_group_rule and tenant:6b951a95c21a452dbbb9c0b8b4bafffa is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:41.052008 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-4d1e4e4f-9f1b-42fd-ad75-9d619c4bc6e0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:41.059589 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-4d1e4e4f-9f1b-42fd-ad75-9d619c4bc6e0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:41.259271 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4d1e4e4f-9f1b-42fd-ad75-9d619c4bc6e0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:41.270009 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4d1e4e4f-9f1b-42fd-ad75-9d619c4bc6e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:41.304687 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:41.465568 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-4d1e4e4f-9f1b-42fd-ad75-9d619c4bc6e0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6b951a95c21a452dbbb9c0b8b4bafffa&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5921984
May 27 09:29:41.466603 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 50360) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:41.471691 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d1e4e4f-9f1b-42fd-ad75-9d619c4bc6e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e1d17cc-df83-4e87-aa27-c6d1d707d92a,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:41.475626 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:41.511264 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ccbab90-6cf5-4f57-9802-eec35a261d68 req-a60e5d60-3013-4ce9-9095-86b4934bfb70 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:41.525134 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7ccbab90-6cf5-4f57-9802-eec35a261d68 req-a60e5d60-3013-4ce9-9095-86b4934bfb70 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.2472892
May 27 09:29:41.547141 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4d1e4e4f-9f1b-42fd-ad75-9d619c4bc6e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.243s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:41.677998 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7ccbab90-6cf5-4f57-9802-eec35a261d68 req-f4a222e9-40f4-438d-9ea9-89d38c6e1afd tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1491218
May 27 09:29:41.698874 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8afeb434-b9dc-4048-aab3-7b5140cde364 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:41.748841 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8afeb434-b9dc-4048-aab3-7b5140cde364 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:41.815783 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-dda5a4ef-2371-4ae1-b844-520e5ae7875b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:41.834752 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8afeb434-b9dc-4048-aab3-7b5140cde364 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:41.843657 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d8986f6f-611d-4254-972d-0c953e8cedc7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:41.873060 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8afeb434-b9dc-4048-aab3-7b5140cde364 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e1d17cc-df83-4e87-aa27-c6d1d707d92a,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:41.879247 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8afeb434-b9dc-4048-aab3-7b5140cde364 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:41.881164 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8afeb434-b9dc-4048-aab3-7b5140cde364 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:41.895505 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-8afeb434-b9dc-4048-aab3-7b5140cde364 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3e1d17cc-df83-4e87-aa27-c6d1d707d92a HTTP/1.1" status: 204  len: 168 time: 0.4190238
May 27 09:29:41.992877 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 50382) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:42.348814 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:42.412681 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f4068418-720c-4882-8cf7-b0efb17a1a0f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:42.435399 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-f4068418-720c-4882-8cf7-b0efb17a1a0f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:42.442744 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-f4068418-720c-4882-8cf7-b0efb17a1a0f admin admin] Usage tracker for resource:security_group_rule and tenant:25c2e388db2340d48adb12073591c64e is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:42.447849 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-f4068418-720c-4882-8cf7-b0efb17a1a0f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:42.457230 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-f4068418-720c-4882-8cf7-b0efb17a1a0f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:42.599788 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f4068418-720c-4882-8cf7-b0efb17a1a0f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:42.604460 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f4068418-720c-4882-8cf7-b0efb17a1a0f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:42.615357 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-cb8c49e0-8b0a-4040-bd5b-2be43961b721 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:42.670849 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-f4068418-720c-4882-8cf7-b0efb17a1a0f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=25c2e388db2340d48adb12073591c64e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6767082
May 27 09:29:42.673803 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4068418-720c-4882-8cf7-b0efb17a1a0f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e6a2d2b-5e66-4272-88da-bf69963dc29b,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:42.675661 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 50402) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:42.678500 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-f4068418-720c-4882-8cf7-b0efb17a1a0f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:42.969556 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a34e3c28-2763-4df8-a0de-4c88b7d51ad3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:43.072802 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a34e3c28-2763-4df8-a0de-4c88b7d51ad3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:43.200980 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-943253ed-c766-4d1d-8b14-3fee88fde1c6 req-e5657e26-ff0e-4569-b3f2-52ea50b7ad74 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:43.228355 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-943253ed-c766-4d1d-8b14-3fee88fde1c6 req-e5657e26-ff0e-4569-b3f2-52ea50b7ad74 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.2964759
May 27 09:29:43.229138 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a34e3c28-2763-4df8-a0de-4c88b7d51ad3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:43.234730 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-04cb5288-13e9-4aaf-81cb-155d0c0d28e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:43.250278 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a34e3c28-2763-4df8-a0de-4c88b7d51ad3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e6a2d2b-5e66-4272-88da-bf69963dc29b,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:43.258116 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a34e3c28-2763-4df8-a0de-4c88b7d51ad3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:43.261131 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a34e3c28-2763-4df8-a0de-4c88b7d51ad3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:43.262562 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-a34e3c28-2763-4df8-a0de-4c88b7d51ad3 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/7e6a2d2b-5e66-4272-88da-bf69963dc29b HTTP/1.1" status: 204  len: 168 time: 0.5855801
May 27 09:29:43.327016 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-943253ed-c766-4d1d-8b14-3fee88fde1c6 req-b684c1d7-af75-48ed-b9f6-b6096eba3c6a tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0941722
May 27 09:29:43.963078 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac4295a2-08ac-45d6-938b-1c7e62e0f48f req-752d8834-2e6e-4905-a737-758d5cc3a8f5 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:43.971712 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ac4295a2-08ac-45d6-938b-1c7e62e0f48f req-752d8834-2e6e-4905-a737-758d5cc3a8f5 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.3605161
May 27 09:29:44.035955 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ac4295a2-08ac-45d6-938b-1c7e62e0f48f req-050f98ef-b54d-42c0-b9cd-fd20cb91fb29 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0624049
May 27 09:29:44.044464 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230ef22c-5024-4539-a6c2-0529d1cb0ea9 req-b774e8a1-fdba-4769-9016-8b092a6646d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:44.048699 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-230ef22c-5024-4539-a6c2-0529d1cb0ea9 req-b774e8a1-fdba-4769-9016-8b092a6646d5 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 1098 time: 0.3347883
May 27 09:29:44.108532 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-230ef22c-5024-4539-a6c2-0529d1cb0ea9 req-ddfc7233-ab17-4f40-93ab-ba73208b2efa service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0456600
May 27 09:29:44.317850 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 50464) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:44.661495 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d191431f-7b3b-44ad-8dde-b0a6d99d3c19 req-64cbb207-8fd1-413f-9082-cc6aae86df17 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:44.678357 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d191431f-7b3b-44ad-8dde-b0a6d99d3c19 req-64cbb207-8fd1-413f-9082-cc6aae86df17 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1789026
May 27 09:29:44.923242 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:44.938054 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0849a2f4-6bb3-49c3-a362-402ccf742055 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:44.960449 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d191431f-7b3b-44ad-8dde-b0a6d99d3c19 req-5758890d-2c16-42b4-8d81-27cc0084724b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2803860
May 27 09:29:45.024194 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0849a2f4-6bb3-49c3-a362-402ccf742055 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:45.033546 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0849a2f4-6bb3-49c3-a362-402ccf742055 admin admin] Usage tracker for resource:security_group_rule and tenant:886b460ce9bc4aa5a6df2b049fd999cc is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:45.040968 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0849a2f4-6bb3-49c3-a362-402ccf742055 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:45.092026 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-526edc05-042d-45dd-81ab-dc7b93059063 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:45.101845 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-526edc05-042d-45dd-81ab-dc7b93059063 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 815 time: 0.3081334
May 27 09:29:45.109752 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0849a2f4-6bb3-49c3-a362-402ccf742055 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:45.313103 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-093e7cc4-2b2d-4a34-870a-17270f396af1 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/quotas/0daf73d9a2424c3e9ccbe74a9d2d94f5 HTTP/1.1" status: 200  len: 375 time: 0.2101195
May 27 09:29:45.420891 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25fccd4d-9389-45f8-820a-5701f7903b1e req-2a69c6ff-21c9-4b75-aec2-fee84c1cb260 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:45.422952 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-25fccd4d-9389-45f8-820a-5701f7903b1e req-2a69c6ff-21c9-4b75-aec2-fee84c1cb260 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.2197359
May 27 09:29:45.426085 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0849a2f4-6bb3-49c3-a362-402ccf742055 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:45.438081 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0849a2f4-6bb3-49c3-a362-402ccf742055 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:45.465671 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:45.532904 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-0849a2f4-6bb3-49c3-a362-402ccf742055 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=886b460ce9bc4aa5a6df2b049fd999cc&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2106533
May 27 09:29:45.535059 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 50516) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:45.543071 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0849a2f4-6bb3-49c3-a362-402ccf742055 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=46c78e09-ff5a-493d-bef1-c9fa9a85481f,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:45.549224 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0849a2f4-6bb3-49c3-a362-402ccf742055 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:45.558914 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-25fccd4d-9389-45f8-820a-5701f7903b1e req-0f9767d0-f967-4a93-8f6f-83aeee21ad9a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1245563
May 27 09:29:45.584369 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-ca171e00-8947-495a-a726-4551274e2bcd tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2702758
May 27 09:29:45.678740 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3b576228-2def-4002-939a-dc17457a6619 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:45.711975 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3b576228-2def-4002-939a-dc17457a6619 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:45.786619 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3b576228-2def-4002-939a-dc17457a6619 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:45.790489 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:45.826315 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b576228-2def-4002-939a-dc17457a6619 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=46c78e09-ff5a-493d-bef1-c9fa9a85481f,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:45.832360 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-4c159d10-7af2-4a57-9d0a-2aa20afc1d7f service neutron] 10.222.0.30 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2467360
May 27 09:29:45.838243 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3b576228-2def-4002-939a-dc17457a6619 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:45.858536 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3b576228-2def-4002-939a-dc17457a6619 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:45.872133 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-3b576228-2def-4002-939a-dc17457a6619 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/46c78e09-ff5a-493d-bef1-c9fa9a85481f HTTP/1.1" status: 204  len: 168 time: 0.3339510
May 27 09:29:46.107586 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-09164735-dadf-4101-9c61-0518697c9d61 service neutron] 10.222.0.30 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2388062
May 27 09:29:46.124451 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20c40680-1b4f-4102-9294-11a3d64bf78a req-2a50d381-34d4-44b3-9a78-b9bb6f5fcef6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:46.126840 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-20c40680-1b4f-4102-9294-11a3d64bf78a req-2a50d381-34d4-44b3-9a78-b9bb6f5fcef6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2132421
May 27 09:29:46.224590 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-20c40680-1b4f-4102-9294-11a3d64bf78a req-527557d3-4f5c-495f-8d17-632ab6a0a715 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0851064
May 27 09:29:46.464259 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1db7e669-16a6-481f-b057-21389f11d003 req-5ffb2aa1-c193-420a-b4bc-18324eab2dfd tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.0547199
May 27 09:29:46.517471 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7671965-ef44-49b1-b428-e862ae28929f req-770e1167-e9c2-4358-ba10-e70e44f7d946 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:46.519993 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e7671965-ef44-49b1-b428-e862ae28929f req-770e1167-e9c2-4358-ba10-e70e44f7d946 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1529183
May 27 09:29:46.596019 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e7671965-ef44-49b1-b428-e862ae28929f req-9fadf6f9-f311-43e6-a796-9b295dd99791 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0643837
May 27 09:29:46.926672 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-724ecf99-a590-4a42-b536-1db322d6bd25 req-c339df89-36e6-4082-ac62-af3e98c49e76 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:46.928641 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-724ecf99-a590-4a42-b536-1db322d6bd25 req-c339df89-36e6-4082-ac62-af3e98c49e76 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.1180162
May 27 09:29:47.037320 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-724ecf99-a590-4a42-b536-1db322d6bd25 req-7090c224-efab-4acf-aefb-3316f3eb52d4 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1001322
May 27 09:29:47.345359 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac178257-3c7a-4e7d-897d-254aa4f5a483 req-5bf05acb-9257-494a-9880-1563df84a9c6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:47.347678 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ac178257-3c7a-4e7d-897d-254aa4f5a483 req-5bf05acb-9257-494a-9880-1563df84a9c6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1684864
May 27 09:29:47.350970 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6eeab5-ac04-43c9-b78d-6dcd77ac3bf6 req-a0a0a0be-e013-41c4-8d46-bb4d09a8bed9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:47.352506 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ae6eeab5-ac04-43c9-b78d-6dcd77ac3bf6 req-a0a0a0be-e013-41c4-8d46-bb4d09a8bed9 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 1098 time: 0.1719258
May 27 09:29:47.609061 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ac178257-3c7a-4e7d-897d-254aa4f5a483 req-86a71430-4205-46f6-935e-ba2437a5a903 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2507610
May 27 09:29:47.687581 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6eeab5-ac04-43c9-b78d-6dcd77ac3bf6 req-0dcff070-1777-4a66-80b6-713935a5f94d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:47.689034 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ae6eeab5-ac04-43c9-b78d-6dcd77ac3bf6 req-0dcff070-1777-4a66-80b6-713935a5f94d service neutron] 10.222.0.11 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 920 time: 0.3073909
May 27 09:29:47.699140 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9a9bf7-731c-4249-b679-67d74ca2b3a8 req-03732ee8-d950-42ed-b47d-6e88b000b6ed tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:47.700855 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cb9a9bf7-731c-4249-b679-67d74ca2b3a8 req-03732ee8-d950-42ed-b47d-6e88b000b6ed tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2868381
May 27 09:29:47.825961 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d8cd1575-5e1d-47cd-9995-1db7aede7425 req-f450af08-0296-4c3d-8d81-d9205a1a5806 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.0537002
May 27 09:29:47.825961 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cb9a9bf7-731c-4249-b679-67d74ca2b3a8 req-a4ec56aa-3dd5-41df-865a-4422c473be80 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1076362
May 27 09:29:48.408503 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c23407-5c12-4907-9a95-cfc3f9c2c807 req-fd707b06-258c-4c1f-8b5a-806d500a9980 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:48.410621 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e4c23407-5c12-4907-9a95-cfc3f9c2c807 req-fd707b06-258c-4c1f-8b5a-806d500a9980 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.1972296
May 27 09:29:48.460341 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e4c23407-5c12-4907-9a95-cfc3f9c2c807 req-75d5d5c6-e9c9-4fa5-9d6d-96a24b1d6090 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430288
May 27 09:29:48.885238 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-969cd278-96a8-468e-a587-2c7e2ada8858 req-eb7b9e42-b852-4a67-9a46-08923b359c5c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:48.887031 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-969cd278-96a8-468e-a587-2c7e2ada8858 req-eb7b9e42-b852-4a67-9a46-08923b359c5c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1038611
May 27 09:29:48.970694 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-969cd278-96a8-468e-a587-2c7e2ada8858 req-e2d89799-8398-4a80-90a2-383145283e26 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0732136
May 27 09:29:49.078196 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b029d3f2-041b-49bc-bc4b-2af91a243d7c req-68657bc0-017a-43b1-86d6-09299bfcaec1 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.0773308
May 27 09:29:49.188503 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e142c062-ec6e-421b-b8dc-dc26e7286ed0 req-1bd70dd8-6f18-4284-9fee-24961c4d2ad4 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:49.190104 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e142c062-ec6e-421b-b8dc-dc26e7286ed0 req-1bd70dd8-6f18-4284-9fee-24961c4d2ad4 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.0958419
May 27 09:29:49.260354 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e142c062-ec6e-421b-b8dc-dc26e7286ed0 req-67ac8bdf-63d8-451c-986b-c4e472696355 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0626590
May 27 09:29:49.669016 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c81f411-493c-448b-b905-134e28756a28 req-460c1a37-321c-4eac-bdf8-72ae0acf4e21 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:49.670608 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2c81f411-493c-448b-b905-134e28756a28 req-460c1a37-321c-4eac-bdf8-72ae0acf4e21 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.0872262
May 27 09:29:49.755729 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2c81f411-493c-448b-b905-134e28756a28 req-3dfaffdd-f9cd-42ba-891d-08a5fd6b8ee1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0770962
May 27 09:29:50.248121 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a0befb-bb7e-47c4-a06c-59ca81a9a0b0 req-8fcbc835-cfb4-4cdf-b106-51a2ebe8b807 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:50.249954 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-04a0befb-bb7e-47c4-a06c-59ca81a9a0b0 req-8fcbc835-cfb4-4cdf-b106-51a2ebe8b807 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1428185
May 27 09:29:50.332883 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-04a0befb-bb7e-47c4-a06c-59ca81a9a0b0 req-44d95de5-3f93-4a83-bc75-a6c65489c354 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0675614
May 27 09:29:50.474605 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c32ff47f-2e4c-4918-aaa4-4889ec866098 req-1763ea2b-f5ae-4970-8794-5b0000c3cca8 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.0883679
May 27 09:29:50.667063 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ae6eeab5-ac04-43c9-b78d-6dcd77ac3bf6 req-a9366113-1e93-401f-908a-d0600bef6601 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=61f95559-dc0a-4418-af09-fd9c84d973ac HTTP/1.1" status: 200  len: 217 time: 0.1910572
May 27 09:29:50.771657 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae6eeab5-ac04-43c9-b78d-6dcd77ac3bf6 req-54f14387-6929-41a8-a9b1-c21f5e319fb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:50.773207 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ae6eeab5-ac04-43c9-b78d-6dcd77ac3bf6 req-54f14387-6929-41a8-a9b1-c21f5e319fb7 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac HTTP/1.1" status: 200  len: 859 time: 0.0922155
May 27 09:29:50.828181 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ae6eeab5-ac04-43c9-b78d-6dcd77ac3bf6 req-acd12a4c-4155-46b6-9803-82dd6827b187 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0479472
May 27 09:29:50.839829 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aca3116-5d63-4dbd-af70-f6e29ec102c0 req-cae8bb8d-3814-462f-ac89-8eaa7222a582 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:50.841245 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2aca3116-5d63-4dbd-af70-f6e29ec102c0 req-cae8bb8d-3814-462f-ac89-8eaa7222a582 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2347000
May 27 09:29:51.085273 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2aca3116-5d63-4dbd-af70-f6e29ec102c0 req-f18a273b-6350-4c0a-bed3-e0edb48b912c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2218201
May 27 09:29:51.139593 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ae6eeab5-ac04-43c9-b78d-6dcd77ac3bf6 req-6b89e154-cfea-4fb3-90e3-7d0858f09d8f service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2972543
May 27 09:29:51.153492 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40925007-b7f2-42dc-b990-64225efd472b req-9e8dd5e3-e869-4e60-9a27-b35ac85de057 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:51.155048 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40925007-b7f2-42dc-b990-64225efd472b req-9e8dd5e3-e869-4e60-9a27-b35ac85de057 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.2511175
May 27 09:29:51.237926 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40925007-b7f2-42dc-b990-64225efd472b req-74fee483-d312-41db-86dd-e8c4c721ae8b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0747793
May 27 09:29:51.450783 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 50616) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:51.572476 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8df2e64-1eba-4c2b-a848-2044421abff2 req-e3c88cef-b1e8-4dc3-9dca-77c576834014 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:51.574065 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b8df2e64-1eba-4c2b-a848-2044421abff2 req-e3c88cef-b1e8-4dc3-9dca-77c576834014 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.0996220
May 27 09:29:51.656415 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b8df2e64-1eba-4c2b-a848-2044421abff2 req-378703b1-0a0c-4891-9ffe-4b88f9c81d04 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0702763
May 27 09:29:51.702460 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dc608113-157d-41a3-a0aa-1a2564e59a9e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:51.729494 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-dc608113-157d-41a3-a0aa-1a2564e59a9e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:51.764909 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-dc608113-157d-41a3-a0aa-1a2564e59a9e admin admin] Usage tracker for resource:security_group_rule and tenant:b1914cd3ef59490294b4a55e10daa6a6 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:29:51.773190 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-dc608113-157d-41a3-a0aa-1a2564e59a9e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:29:51.785507 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-567a748f-a0de-4058-8fd8-a4009dc06f7c req-a98a5eec-99e7-457f-9a76-e32cb2106f02 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.0573204
May 27 09:29:51.786469 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-dc608113-157d-41a3-a0aa-1a2564e59a9e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:51.896291 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dc608113-157d-41a3-a0aa-1a2564e59a9e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:51.900600 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dc608113-157d-41a3-a0aa-1a2564e59a9e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:51.910744 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0849a2f4-6bb3-49c3-a362-402ccf742055 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:51.953637 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-dc608113-157d-41a3-a0aa-1a2564e59a9e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b1914cd3ef59490294b4a55e10daa6a6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5013666
May 27 09:29:51.957017 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc608113-157d-41a3-a0aa-1a2564e59a9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aded111d-a829-47ce-8244-70c941f41b58,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:51.958181 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 50626) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:29:51.961587 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dc608113-157d-41a3-a0aa-1a2564e59a9e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:52.027003 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-371dbd2e-4c43-4082-973b-1b2a84cdee06 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:52.056199 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-371dbd2e-4c43-4082-973b-1b2a84cdee06 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:52.118179 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-371dbd2e-4c43-4082-973b-1b2a84cdee06 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:52.122173 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6f6dbcd1-238f-4074-89b8-b612d4bbc98c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:52.134791 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-371dbd2e-4c43-4082-973b-1b2a84cdee06 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aded111d-a829-47ce-8244-70c941f41b58,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:52.138437 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-371dbd2e-4c43-4082-973b-1b2a84cdee06 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:52.142179 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-371dbd2e-4c43-4082-973b-1b2a84cdee06 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:52.147152 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-371dbd2e-4c43-4082-973b-1b2a84cdee06 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/aded111d-a829-47ce-8244-70c941f41b58 HTTP/1.1" status: 204  len: 168 time: 0.1874614
May 27 09:29:52.372932 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46cad36a-8153-40a8-97c2-32ca0124bca7 req-47ee4b78-b423-4e40-a5a4-3f7785c9e3d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:52.374843 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46cad36a-8153-40a8-97c2-32ca0124bca7 req-47ee4b78-b423-4e40-a5a4-3f7785c9e3d9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1344593
May 27 09:29:52.484563 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46cad36a-8153-40a8-97c2-32ca0124bca7 req-7c9b8111-1a92-48fd-94d8-1eb60a649298 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0744352
May 27 09:29:52.517746 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26d75abd-118c-4d8a-b4c5-628a0a399b52 req-d1cd50aa-0a37-4ec4-a801-962da83b4f66 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:52.520387 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-26d75abd-118c-4d8a-b4c5-628a0a399b52 req-d1cd50aa-0a37-4ec4-a801-962da83b4f66 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.1553886
May 27 09:29:52.574358 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-26d75abd-118c-4d8a-b4c5-628a0a399b52 req-56dc8ff2-80c8-4033-a449-48ee91a9eef5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0475218
May 27 09:29:52.941922 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cadfde9-eac5-4d44-9d03-6b590a0848c5 req-c8c7c3f3-0604-4b59-9fa2-fe1cac1f36a6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:52.943090 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3cadfde9-eac5-4d44-9d03-6b590a0848c5 req-c8c7c3f3-0604-4b59-9fa2-fe1cac1f36a6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1484280
May 27 09:29:53.150116 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3cadfde9-eac5-4d44-9d03-6b590a0848c5 req-c5e8bf69-2641-4585-801e-6a420fd3f367 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1940105
May 27 09:29:53.157480 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1267e57f-0cc3-4056-bca0-3519424787ab req-c9371deb-6e4b-401c-b4b8-8f032d381ded tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.1559718
May 27 09:29:53.760915 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837fb7ed-e709-413e-b37f-a204de007fd5 req-a6726a5b-ada8-4e15-8a6f-306c8ddfeb8b tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:53.763513 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-837fb7ed-e709-413e-b37f-a204de007fd5 req-a6726a5b-ada8-4e15-8a6f-306c8ddfeb8b tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1519253
May 27 09:29:53.872341 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-837fb7ed-e709-413e-b37f-a204de007fd5 req-dc017691-d91c-4070-9fd4-0fd2ee5b9aaa tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0654311
May 27 09:29:53.908022 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a2f54d-7037-4cc5-8486-3a4161646ec1 req-8d6c9fd0-81fe-4314-ae4c-afaced52ec75 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:53.911314 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40a2f54d-7037-4cc5-8486-3a4161646ec1 req-8d6c9fd0-81fe-4314-ae4c-afaced52ec75 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.1463392
May 27 09:29:53.964782 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40a2f54d-7037-4cc5-8486-3a4161646ec1 req-4feacb85-4a1e-4280-affa-f7208880b13d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0467777
May 27 09:29:54.261048 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ae6eeab5-ac04-43c9-b78d-6dcd77ac3bf6 req-f6c4c7e0-6548-4d18-b116-c1049fc6af0b service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2483678
May 27 09:29:54.526281 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bfe2df1a-5a19-45f1-bb6c-7d2c9c2b202d req-eac589fe-8786-4c30-a585-bec3b470ee92 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.1300316
May 27 09:29:54.742074 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-049efa20-9ec8-4fbd-a7be-88e2e3808ed5 req-89c7c958-a73c-4591-85e7-904f0084c8b0 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:54.744719 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-049efa20-9ec8-4fbd-a7be-88e2e3808ed5 req-89c7c958-a73c-4591-85e7-904f0084c8b0 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.3948848
May 27 09:29:54.760876 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-4f4a092a-6016-4a63-a948-f39f76df744b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:54.762834 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-4f4a092a-6016-4a63-a948-f39f76df744b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 815 time: 0.2792025
May 27 09:29:54.791931 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Request body: {'port': {'device_id': '6284c06f-2253-4d19-b502-1332d55684cc', 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965', 'admin_state_up': True, 'tenant_id': '0daf73d9a2424c3e9ccbe74a9d2d94f5'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:54.930470 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-049efa20-9ec8-4fbd-a7be-88e2e3808ed5 req-573f9ed3-6730-4490-acb5-093d19f5784a tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1653063
May 27 09:29:55.001979 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:29:55.015421 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:29:55.033127 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Made reservation on behalf of 0daf73d9a2424c3e9ccbe74a9d2d94f5 for: {'port': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:29:55.037379 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:55.374925 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5c833e6-b363-4e5a-895e-dfa625ca5c35 req-8d1badab-3a13-4606-a17b-f849be9038a0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:55.376558 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b5c833e6-b363-4e5a-895e-dfa625ca5c35 req-8d1badab-3a13-4606-a17b-f849be9038a0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2527905
May 27 09:29:55.412627 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Allocated IP 172.20.0.7 (7cbf7538-2626-435d-83dd-e10fb0c9e965/3d70d479-f390-4cd8-90ff-49a918615aa4/8cbe31e4-ac6c-42df-8d4e-a93e185158ac) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:29:55.437084 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-948427eb-0cb6-442c-bb50-254d635e7d18 req-b4eabd9f-708f-4551-9bc9-df54d14e6d43 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:55.438643 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-948427eb-0cb6-442c-bb50-254d635e7d18 req-b4eabd9f-708f-4551-9bc9-df54d14e6d43 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.2597721
May 27 09:29:55.501858 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b5c833e6-b363-4e5a-895e-dfa625ca5c35 req-e3e8afbb-cbe1-4f0e-a3bb-aeab7e36df28 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1103909
May 27 09:29:55.559573 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-948427eb-0cb6-442c-bb50-254d635e7d18 req-16cefa07-ac41-42f0-a49e-f50b8b3e02e4 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1048291
May 27 09:29:55.788518 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1743b5fa-1d5c-41fa-8161-cf8fb2cdd959 req-dd92104f-50a6-4f08-b292-e56b9079ede1 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.0672104
May 27 09:29:55.797532 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:55.837768 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:55.845925 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:55.854567 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['2890994f-299e-4a4d-8e0a-945b6c38ecfe', '51dd2656-44f3-41cb-b4e3-38beccc875b4', '494fef8d-4a46-4dc4-8bdc-d2550769b2dd'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:29:55.951855 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Network 7cbf7538-2626-435d-83dd-e10fb0c9e965 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:29:55.966862 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:29:55.976163 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:29:56.097864 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Pushing event updated for resources: {'Port': ['ID=8cbe31e4-ac6c-42df-8d4e-a93e185158ac,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:56.119529 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.274s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:56.147148 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:56.148587 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:56.242934 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4546714
May 27 09:29:56.265272 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Request body: {'port': {'device_id': '6284c06f-2253-4d19-b502-1332d55684cc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:29:56.435658 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:56.727595 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:56.991188 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95d6872f-bf4a-4047-9ebc-09cfe0a0bb9c req-489be1e5-288a-4729-95ae-a6501463fd43 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:56.993854 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-95d6872f-bf4a-4047-9ebc-09cfe0a0bb9c req-489be1e5-288a-4729-95ae-a6501463fd43 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.6770887
May 27 09:29:57.185283 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-95d6872f-bf4a-4047-9ebc-09cfe0a0bb9c req-4cdf0a3d-7c93-4eac-af09-dbfb28a74a67 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1841908
May 27 09:29:57.219986 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6bac649-5ba8-4bdb-8740-eeaf0ae0edc7 req-8f319a28-123f-48be-87cb-fb3fb9fdacbe tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:57.221701 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b6bac649-5ba8-4bdb-8740-eeaf0ae0edc7 req-8f319a28-123f-48be-87cb-fb3fb9fdacbe tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.4562080
May 27 09:29:57.401827 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b6bac649-5ba8-4bdb-8740-eeaf0ae0edc7 req-16e9354a-710a-4cff-9848-d4be260313be tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1361110
May 27 09:29:57.541006 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf06e6b-1f44-4b3a-81f4-3b794d34f6df req-a10202ba-71b4-47b6-906b-adae74221515 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:57.542631 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-edf06e6b-1f44-4b3a-81f4-3b794d34f6df req-a10202ba-71b4-47b6-906b-adae74221515 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.2479653
May 27 09:29:57.575525 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8cbe31e4-ac6c-42df-8d4e-a93e185158ac {{(pid=91821) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:29:57.590851 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:57.689283 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Transition to ACTIVE for port object 8cbe31e4-ac6c-42df-8d4e-a93e185158ac will not be triggered until provisioned by entity L2. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:29:57.694004 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-edf06e6b-1f44-4b3a-81f4-3b794d34f6df req-e773f264-0a46-44ce-a000-28d73df231a2 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1449647
May 27 09:29:57.696698 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:57.710629 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:57.942819 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Pushing event updated for resources: {'Port': ['ID=8cbe31e4-ac6c-42df-8d4e-a93e185158ac,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:57.958680 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911429b1-73fd-40a8-8452-5008cd391677 req-c809b4e0-fa35-41e6-bd1c-64cf43af9f2f tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:57.959465 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-911429b1-73fd-40a8-8452-5008cd391677 req-c809b4e0-fa35-41e6-bd1c-64cf43af9f2f tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Synchronizing usage tracker for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:29:57.962514 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.252s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:58.029643 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-911429b1-73fd-40a8-8452-5008cd391677 req-c809b4e0-fa35-41e6-bd1c-64cf43af9f2f tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Unset dirty status for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:29:58.030868 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-911429b1-73fd-40a8-8452-5008cd391677 req-c809b4e0-fa35-41e6-bd1c-64cf43af9f2f tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 931 time: 0.4436646
May 27 09:29:58.071249 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Attempting to bind port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:29:58.071640 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Attempting to bind port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:29:58.071969 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Attempting to bind port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:29:58.080495 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:29:58.081456 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Attempting to bind port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac on network 7cbf7538-2626-435d-83dd-e10fb0c9e965 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:29:58.103510 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 29, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:29:58.103864 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Checking segment: {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:29:58.104354 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Bound using segment: {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:29:58.104815 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Bound port: 8cbe31e4-ac6c-42df-8d4e-a93e185158ac, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5cc9fe82-a594-45e0-8c16-9cade14c2ef5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 386, 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965'}}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:29:58.105147 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:58.127254 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-911429b1-73fd-40a8-8452-5008cd391677 req-7882e5f8-0b69-4f8e-ab1a-00c4d9cafcd1 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0815535
May 27 09:29:58.250743 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] For port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac, host hv-cinder-77262, cleared binding levels {{(pid=91821) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:29:58.256541 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] For port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=8cbe31e4-ac6c-42df-8d4e-a93e185158ac,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91821) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:29:58.262934 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:58.269984 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:29:58.393247 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:58.394133 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:29:58.395761 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] 10.222.0.11 "PUT /v2.0/ports/8cbe31e4-ac6c-42df-8d4e-a93e185158ac HTTP/1.1" status: 200  len: 1093 time: 2.1445637
May 27 09:29:58.396298 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6284c06f-2253-4d19-b502-1332d55684cc', 'tag': '8cbe31e4-ac6c-42df-8d4e-a93e185158ac'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:29:58.434311 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Pushing event updated for resources: {'Port': ['ID=8cbe31e4-ac6c-42df-8d4e-a93e185158ac,revision_number=3']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:29:58.437456 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:29:58.465335 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6284c06f-2253-4d19-b502-1332d55684cc', 'tag': '8cbe31e4-ac6c-42df-8d4e-a93e185158ac', 'status': 'completed', 'code': 200}
May 27 09:29:58.523693 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4220f532-fee6-4e55-9ed8-d116318af145 req-cbfebdd5-0284-47db-978a-688530d9c0a8 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:58.525323 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4220f532-fee6-4e55-9ed8-d116318af145 req-cbfebdd5-0284-47db-978a-688530d9c0a8 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1949110
May 27 09:29:58.642140 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4220f532-fee6-4e55-9ed8-d116318af145 req-41d78176-55a8-4470-9e71-14619df3e6db tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1052480
May 27 09:29:58.672349 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-d2203afb-8396-4537-931e-fd00b5228075 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:58.673930 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-d2203afb-8396-4537-931e-fd00b5228075 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 1096 time: 0.2040195
May 27 09:29:58.760745 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-5134245e-de3d-44dc-92fb-2247dc8a0b02 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8cbe31e4-ac6c-42df-8d4e-a93e185158ac HTTP/1.1" status: 200  len: 217 time: 0.0740705
May 27 09:29:59.015847 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30bfa917-2428-46ae-b16f-f5c3a9147996 req-2de951fe-7c30-4193-b0ef-01ee36fee7d4 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:59.024119 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-30bfa917-2428-46ae-b16f-f5c3a9147996 req-2de951fe-7c30-4193-b0ef-01ee36fee7d4 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.4317720
May 27 09:29:59.085664 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-af17029c-ed96-4cd0-82fe-580131c2e899 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:59.087274 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-af17029c-ed96-4cd0-82fe-580131c2e899 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3d70d479-f390-4cd8-90ff-49a918615aa4 HTTP/1.1" status: 200  len: 855 time: 0.3139436
May 27 09:29:59.163967 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-bf5338cf-5d5b-4128-b8a1-101c63b474c8 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7cbf7538-2626-435d-83dd-e10fb0c9e965&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0689037
May 27 09:29:59.220527 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-30bfa917-2428-46ae-b16f-f5c3a9147996 req-9120e226-2e7a-40bd-b72d-3ebd1a7e5572 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1850369
May 27 09:29:59.317993 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43a655d1-369b-4a9e-af8d-3aa8aeba2de3 req-a09797d4-ae7e-46a0-83be-524ea0ef06ae tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:59.325489 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-43a655d1-369b-4a9e-af8d-3aa8aeba2de3 req-a09797d4-ae7e-46a0-83be-524ea0ef06ae tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.3620441
May 27 09:29:59.463269 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-43a655d1-369b-4a9e-af8d-3aa8aeba2de3 req-3876cf6e-05ff-4756-a584-ea70e933b7f8 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1367860
May 27 09:29:59.493606 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-e3b4e69e-0994-4b0b-8ae9-144951612da1 service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3222396
May 27 09:29:59.669200 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e429626d-184d-4935-a53e-821f48b674d8 req-d15cb056-b699-4ff3-8307-acad3d6e595d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:59.676255 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e429626d-184d-4935-a53e-821f48b674d8 req-d15cb056-b699-4ff3-8307-acad3d6e595d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 943 time: 0.2733560
May 27 09:29:59.709358 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46f67ee0-50c3-4764-b614-c19d7e0c5cfe req-f7567341-4803-4e90-bf34-072268be0e5b service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2081406
May 27 09:29:59.747049 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e429626d-184d-4935-a53e-821f48b674d8 req-51928585-24f0-4058-8946-8fdabc2480ed tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0696540
May 27 09:29:59.906275 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bcf7ef3-b646-48d6-8610-95ee7ed6dd0c req-2329946a-6244-4211-91a3-8cc2173a14ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:29:59.907866 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2bcf7ef3-b646-48d6-8610-95ee7ed6dd0c req-2329946a-6244-4211-91a3-8cc2173a14ff service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 1096 time: 0.1223059
May 27 09:30:00.115181 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-82fcc002-06ee-473a-b099-fe97ba533314 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1870673697&fields=id&tenant_id=a31154df1ce4420f9bdf53b8b3b3649e HTTP/1.1" status: 200  len: 267 time: 0.0769944
May 27 09:30:00.216200 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bcf7ef3-b646-48d6-8610-95ee7ed6dd0c req-729c5cf3-c314-4a62-9d73-b1af73cee8d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:00.217565 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2bcf7ef3-b646-48d6-8610-95ee7ed6dd0c req-729c5cf3-c314-4a62-9d73-b1af73cee8d0 service neutron] 10.222.0.11 "GET /v2.0/networks?id=7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 200  len: 916 time: 0.3023152
May 27 09:30:00.306390 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2bcf7ef3-b646-48d6-8610-95ee7ed6dd0c req-88d8f960-168f-47d0-9f11-3ae4235b70c2 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=8cbe31e4-ac6c-42df-8d4e-a93e185158ac HTTP/1.1" status: 200  len: 217 time: 0.0740089
May 27 09:30:00.478746 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-6b999c51-6e78-45d9-92dd-f37f0ebdf978 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:00.480649 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-6b999c51-6e78-45d9-92dd-f37f0ebdf978 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/networks?id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba HTTP/1.1" status: 200  len: 808 time: 0.3577690
May 27 09:30:00.500955 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bcf7ef3-b646-48d6-8610-95ee7ed6dd0c req-4ef22f74-e80b-464c-b290-d539842d4aae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:00.502399 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2bcf7ef3-b646-48d6-8610-95ee7ed6dd0c req-4ef22f74-e80b-464c-b290-d539842d4aae service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3d70d479-f390-4cd8-90ff-49a918615aa4 HTTP/1.1" status: 200  len: 855 time: 0.1871212
May 27 09:30:00.556878 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-c96deaad-64ae-494a-828a-a3a72a5db7ae tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/quotas/a31154df1ce4420f9bdf53b8b3b3649e HTTP/1.1" status: 200  len: 375 time: 0.0577118
May 27 09:30:00.565110 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2bcf7ef3-b646-48d6-8610-95ee7ed6dd0c req-7acd46a4-2fcb-4785-b460-28ea84216ff5 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7cbf7538-2626-435d-83dd-e10fb0c9e965&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0516691
May 27 09:30:00.741798 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0af41428-e747-40d1-b748-2c2ab63bfa4d req-e0b622be-b473-4377-b316-7662d9cc7f37 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:00.743358 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0af41428-e747-40d1-b748-2c2ab63bfa4d req-e0b622be-b473-4377-b316-7662d9cc7f37 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.3609366
May 27 09:30:00.839883 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0af41428-e747-40d1-b748-2c2ab63bfa4d req-b5b2f929-b118-4480-abc7-a9b94bf0861f tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0865512
May 27 09:30:00.842034 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2bcf7ef3-b646-48d6-8610-95ee7ed6dd0c req-e4951cb2-16de-4077-9eab-731c64b50d6c service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2306705
May 27 09:30:00.849940 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-7b0fdbe1-a70e-4312-ad1d-fba3ee81ef0c tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=a31154df1ce4420f9bdf53b8b3b3649e&fields=id HTTP/1.1" status: 200  len: 302 time: 0.2825274
May 27 09:30:01.100489 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:30:01.352520 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2bcf7ef3-b646-48d6-8610-95ee7ed6dd0c req-da3ecbdc-8a3b-49ca-b96e-3e4030d4e8ff service neutron] 10.222.0.11 "GET /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.5015395
May 27 09:30:01.358422 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-8e3d11d5-074b-4e8e-8627-16b94ee2c8cd service neutron] 10.222.0.30 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4779408
May 27 09:30:01.433093 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fc7c1a9-580d-494a-9ec7-d2d87721b108 req-ca7950b3-aff2-47ab-8b52-073434411c78 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:01.435949 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4fc7c1a9-580d-494a-9ec7-d2d87721b108 req-ca7950b3-aff2-47ab-8b52-073434411c78 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.3330009
May 27 09:30:01.665667 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4fc7c1a9-580d-494a-9ec7-d2d87721b108 req-7630e3f1-43f7-48a2-b2e1-f2093ec365de tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2225652
May 27 09:30:01.763097 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-1635fe34-ae23-46f6-8bdb-688e8e8d4d59 service neutron] 10.222.0.30 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3893220
May 27 09:30:01.944035 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 8cbe31e4-ac6c-42df-8d4e-a93e185158ac details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:30:01.963532 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdeec301-5ace-4aec-b33e-c097d49d89de req-93b70f3c-1368-4713-a48a-0d34c0ffade2 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:01.965321 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bdeec301-5ace-4aec-b33e-c097d49d89de req-93b70f3c-1368-4713-a48a-0d34c0ffade2 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1632893
May 27 09:30:02.030142 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bdeec301-5ace-4aec-b33e-c097d49d89de req-025cf467-93dd-4739-b208-9ed3e0ca09aa tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0577641
May 27 09:30:02.139089 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=8cbe31e4-ac6c-42df-8d4e-a93e185158ac,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:02.160260 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '8cbe31e4-ac6c-42df-8d4e-a93e185158ac', 'network_id': '7cbf7538-2626-435d-83dd-e10fb0c9e965', 'port_id': '8cbe31e4-ac6c-42df-8d4e-a93e185158ac', 'mac_address': 'fa:16:3e:b3:80:d2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 386, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3d70d479-f390-4cd8-90ff-49a918615aa4', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:30:02.260183 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:02.292986 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8cbe31e4-ac6c-42df-8d4e-a93e185158ac {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:30:02.300372 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-512d94cb-022f-4631-b857-a459840fcf86 req-dc0ee67d-d3bf-4ded-98ed-cbd8b3240f8b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:02.314508 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-512d94cb-022f-4631-b857-a459840fcf86 req-dc0ee67d-d3bf-4ded-98ed-cbd8b3240f8b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 943 time: 0.1252682
May 27 09:30:02.326229 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=8cbe31e4-ac6c-42df-8d4e-a93e185158ac,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:02.332920 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:02.336020 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-b6cc52e7-ee28-460c-84f3-b1c7d85e8e17 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:02.383237 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-512d94cb-022f-4631-b857-a459840fcf86 req-943d39bb-5b4f-4401-960c-3bab3c97ed97 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0677249
May 27 09:30:02.455052 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=8cbe31e4-ac6c-42df-8d4e-a93e185158ac,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:02.464502 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:02.588343 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d09354b-e1bd-4d11-8b1a-bda6b5db439d req-d4588650-b929-441e-acf9-b8fba2498ea7 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:02.590208 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1d09354b-e1bd-4d11-8b1a-bda6b5db439d req-d4588650-b929-441e-acf9-b8fba2498ea7 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1128666
May 27 09:30:02.651729 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1d09354b-e1bd-4d11-8b1a-bda6b5db439d req-b2661fb7-9bd8-4a52-b71d-8678c8faf0c0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0548344
May 27 09:30:02.710966 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['8cbe31e4-ac6c-42df-8d4e-a93e185158ac'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:30:02.796342 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c8134b88-5a46-4fc6-84dc-a63ca158a907 req-bed2830b-d086-4b36-9ad0-34959d18f50f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 210 time: 0.0735412
May 27 09:30:03.091898 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcddca42-f66b-48bf-a409-1ea77e72884b req-ee6a16c3-e518-4444-b5a9-608122a2dc74 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:03.094717 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bcddca42-f66b-48bf-a409-1ea77e72884b req-ee6a16c3-e518-4444-b5a9-608122a2dc74 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.1319287
May 27 09:30:03.211596 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bcddca42-f66b-48bf-a409-1ea77e72884b req-74907813-16e8-4fba-88c7-b8d31b20916e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1091585
May 27 09:30:03.636829 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b62758-f4a4-48ba-a055-0bc14303b360 req-505f7dcf-d365-4034-a792-39b31022f48f tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:03.638559 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d9b62758-f4a4-48ba-a055-0bc14303b360 req-505f7dcf-d365-4034-a792-39b31022f48f tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 944 time: 0.1130543
May 27 09:30:03.717508 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d9b62758-f4a4-48ba-a055-0bc14303b360 req-3c98f8ab-c193-4080-919d-14f6ba477f33 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0723228
May 27 09:30:03.895790 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56228dbc-8ef6-4f2a-9774-32b446363539 req-f28b4a3a-cddc-400c-ae58-abed2489fb1c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:03.898345 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-56228dbc-8ef6-4f2a-9774-32b446363539 req-f28b4a3a-cddc-400c-ae58-abed2489fb1c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1180220
May 27 09:30:04.013810 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-56228dbc-8ef6-4f2a-9774-32b446363539 req-61be6c25-4872-4473-9a80-28ac3263ce72 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1088634
May 27 09:30:04.022780 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fa55ce80-e12b-4c4c-adbe-5b23b5b9c115 req-0536978e-fdcc-4f5e-8d8e-b5250661beca tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 210 time: 0.0601115
May 27 09:30:04.508056 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1368387c-084d-48c5-a8fb-0ea80c366916 req-315a1022-280d-42d4-aae6-3572a3e139db tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:04.510614 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1368387c-084d-48c5-a8fb-0ea80c366916 req-315a1022-280d-42d4-aae6-3572a3e139db tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.1676941
May 27 09:30:04.567998 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1368387c-084d-48c5-a8fb-0ea80c366916 req-d451272d-9dd6-4d4e-b3b7-89a363652afe tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0513890
May 27 09:30:04.928714 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee7839fb-beb1-4205-840e-3beccfbded58 req-08d3bae7-79d6-4789-936e-3d162275090c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:04.930487 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ee7839fb-beb1-4205-840e-3beccfbded58 req-08d3bae7-79d6-4789-936e-3d162275090c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 944 time: 0.0938909
May 27 09:30:04.985799 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ee7839fb-beb1-4205-840e-3beccfbded58 req-bafa1d74-b8a1-4c85-8238-8cfb13e1faf8 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445647
May 27 09:30:05.278921 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2a885b84-9518-4203-9542-293c0165c606 req-be4ef92d-5df0-4119-b5ab-4d5dd943adce tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 210 time: 0.0893924
May 27 09:30:05.326387 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88cde944-276d-49cd-ba9c-1ba31c411a20 req-cc1c727c-3f17-41e2-bc83-c1dc52901f10 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:05.328058 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-88cde944-276d-49cd-ba9c-1ba31c411a20 req-cc1c727c-3f17-41e2-bc83-c1dc52901f10 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1020398
May 27 09:30:05.382056 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-88cde944-276d-49cd-ba9c-1ba31c411a20 req-caaf3f85-9c02-4ec8-871c-57a0e895b4c4 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0454504
May 27 09:30:05.813094 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ea0237-299d-4a6a-90e4-3af314175017 req-5f82cb9c-d933-455b-98cc-e1b2bfce77e3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:05.814564 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b5ea0237-299d-4a6a-90e4-3af314175017 req-5f82cb9c-d933-455b-98cc-e1b2bfce77e3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.0995886
May 27 09:30:05.872521 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b5ea0237-299d-4a6a-90e4-3af314175017 req-4ffdb99f-d153-41bb-bd56-4ac84f27242d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0506392
May 27 09:30:06.223534 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8634e8c5-98b7-41fd-a962-7c38770f6f96 req-f01926f0-b9e9-44ee-856c-c4680e9c2401 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:06.225182 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8634e8c5-98b7-41fd-a962-7c38770f6f96 req-f01926f0-b9e9-44ee-856c-c4680e9c2401 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 944 time: 0.1166792
May 27 09:30:06.295099 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8634e8c5-98b7-41fd-a962-7c38770f6f96 req-87deec0d-658c-4e21-aca8-0f507f5642e8 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0590742
May 27 09:30:06.620992 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-88a5808b-829d-4ce7-905e-fb63df630da7 req-9dcf969f-adbe-4a34-8d25-7a21f4c4622b tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 210 time: 0.2007592
May 27 09:30:06.698616 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6f84de2-cdd0-4bfa-badc-4c6bf520eae2 req-758d30c6-836d-4520-b824-57ba9bf95f58 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:06.703301 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a6f84de2-cdd0-4bfa-badc-4c6bf520eae2 req-758d30c6-836d-4520-b824-57ba9bf95f58 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1422045
May 27 09:30:06.757672 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a6f84de2-cdd0-4bfa-badc-4c6bf520eae2 req-506e0abb-7e62-4eb3-9398-9f77a5a95435 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0478771
May 27 09:30:07.320137 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b23e8738-a976-4427-a54f-4bd4163485a5 req-4ac71174-60af-483c-87c9-1716f7aa95d5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:07.322712 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b23e8738-a976-4427-a54f-4bd4163485a5 req-4ac71174-60af-483c-87c9-1716f7aa95d5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.3018074
May 27 09:30:07.366008 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-2e863370-fa95-4603-92d4-b0e34333343a tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:07.367884 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-2e863370-fa95-4603-92d4-b0e34333343a tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.11 "GET /v2.0/networks?id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba HTTP/1.1" status: 200  len: 808 time: 0.3889768
May 27 09:30:07.426316 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b23e8738-a976-4427-a54f-4bd4163485a5 req-dde71e8c-d705-44eb-8eed-9d0ee4ecd42d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0939181
May 27 09:30:07.495179 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-62ae7fc6-24fc-4df3-ac10-5d5b3d4a125f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a31154df1ce4420f9bdf53b8b3b3649e HTTP/1.1" status: 200  len: 380 time: 0.1025093
May 27 09:30:07.504967 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Request body: {'port': {'device_id': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'admin_state_up': True, 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'security_groups': ['bb8c2c8f-2cda-4331-ba72-b49f4c7550dd']}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:30:07.657835 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-183fc2ca-bb40-4828-9e4b-45bf02ce953a req-c035baaf-c2aa-40a4-8a1b-9e9fefae0eae tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:07.660330 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-183fc2ca-bb40-4828-9e4b-45bf02ce953a req-c035baaf-c2aa-40a4-8a1b-9e9fefae0eae tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 944 time: 0.2250247
May 27 09:30:07.707415 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:07.717740 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Usage tracker for resource:port and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:07.722774 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Quota usage for port was recalculated. Used quota:2. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:07.734446 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:07.743594 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-183fc2ca-bb40-4828-9e4b-45bf02ce953a req-4b7e33bd-f421-4997-95cf-e4d32e88b387 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0710826
May 27 09:30:07.760056 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Made reservation on behalf of a31154df1ce4420f9bdf53b8b3b3649e for: {'port': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:30:07.770243 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:07.984656 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a3fbb44b-bbc6-4873-b456-258ac59c685c req-bf5d1643-6b9a-4623-b701-2c543db291b7 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 210 time: 0.0741823
May 27 09:30:08.196375 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Allocated IP 172.20.0.9 (1f49b134-af0c-46a8-b862-f6cb6b6a0bba/6659533b-b3b0-4d3c-8bf0-709a19b7728d/9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:30:08.215341 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aab7d8ba-e91f-447b-afeb-61cdee78b5a3 req-0fba4bdb-3781-4d06-b6b9-a278014faf2c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:08.216926 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-aab7d8ba-e91f-447b-afeb-61cdee78b5a3 req-0fba4bdb-3781-4d06-b6b9-a278014faf2c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2048945
May 27 09:30:08.398336 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-aab7d8ba-e91f-447b-afeb-61cdee78b5a3 req-e0423d5f-a373-431b-a9da-6366f6097cbd tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1726723
May 27 09:30:08.498345 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-aa80596f-fec7-4128-a6e7-980081bae5ab None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:08.526560 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:08.552806 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Transition to ACTIVE for port object 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d will not be triggered until provisioned by entity DHCP. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:30:08.628096 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:08.646975 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-75e36b01-57df-4888-86cd-2100ddbe9424 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:08.727854 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:30:08.731326 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:30:08.736188 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:30:08.789265 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event updated for resources: {'Port': ['ID=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:08.805930 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.806317 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.806671 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.807029 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.807827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.807827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.808091 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.808439 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.808788 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.809135 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.809479 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.809821 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:08.811969 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 8cbe31e4-ac6c-42df-8d4e-a93e185158ac up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:30:08.816987 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:08.824950 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-420419a5-3d7c-4870-a0aa-fb23a97db4bd req-9870c425-0580-4db6-b922-7c89b3238b4c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:08.826501 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-420419a5-3d7c-4870-a0aa-fb23a97db4bd req-9870c425-0580-4db6-b922-7c89b3238b4c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.2502692
May 27 09:30:08.868409 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:08.869057 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:08.901518 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-420419a5-3d7c-4870-a0aa-fb23a97db4bd req-5be2e2a2-9f79-427b-b9ae-77de04142452 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0641170
May 27 09:30:08.907980 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:30:08.912042 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4112968
May 27 09:30:08.915244 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:30:08.915688 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:08.962921 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Request body: {'port': {'device_id': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:30:09.007491 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-95ced51b-cadb-476b-9331-60d06f693ff1 None None] Provisioning for port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:30:09.017137 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-95ced51b-cadb-476b-9331-60d06f693ff1 None None] Provisioning complete for port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:30:09.017774 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-95ced51b-cadb-476b-9331-60d06f693ff1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:09.146778 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ce3071b-00ea-4ec0-a068-af0bd1f9a460 req-274709be-b7c5-4699-a46e-d5145e4bb90e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:09.154885 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ce3071b-00ea-4ec0-a068-af0bd1f9a460 req-274709be-b7c5-4699-a46e-d5145e4bb90e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 944 time: 0.2416470
May 27 09:30:09.179534 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:09.211742 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-95ced51b-cadb-476b-9331-60d06f693ff1 None None] Port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:30:09.234484 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:09.281342 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6284c06f-2253-4d19-b502-1332d55684cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8cbe31e4-ac6c-42df-8d4e-a93e185158ac'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:30:09.293327 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=8cbe31e4-ac6c-42df-8d4e-a93e185158ac,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:09.298813 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:09.300795 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:09.384185 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=8cbe31e4-ac6c-42df-8d4e-a93e185158ac,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:09.387800 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:09.458162 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ce3071b-00ea-4ec0-a068-af0bd1f9a460 req-c911d42d-6fe4-4d59-b840-66b15d58794c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3017507
May 27 09:30:09.582032 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6284c06f-2253-4d19-b502-1332d55684cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8cbe31e4-ac6c-42df-8d4e-a93e185158ac', 'code': 200}
May 27 09:30:09.623230 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e3d2c39-0f9e-4c0c-a1da-5883ea88e619 req-cb577806-0076-4325-bfe9-4260376b813b tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:09.624440 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-8e3d2c39-0f9e-4c0c-a1da-5883ea88e619 req-cb577806-0076-4325-bfe9-4260376b813b tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Synchronizing usage tracker for tenant:a31154df1ce4420f9bdf53b8b3b3649e on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:30:09.765610 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-8e3d2c39-0f9e-4c0c-a1da-5883ea88e619 req-cb577806-0076-4325-bfe9-4260376b813b tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Unset dirty status for tenant:a31154df1ce4420f9bdf53b8b3b3649e on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:30:09.767775 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8e3d2c39-0f9e-4c0c-a1da-5883ea88e619 req-cb577806-0076-4325-bfe9-4260376b813b tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 931 time: 0.5650022
May 27 09:30:09.976702 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5f39f6e-db95-4c5e-99fc-411bca954cef req-ff013131-4af3-4272-90b2-0d0ac9e94867 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:09.978892 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-b5f39f6e-db95-4c5e-99fc-411bca954cef req-ff013131-4af3-4272-90b2-0d0ac9e94867 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 1098 time: 0.0976305
May 27 09:30:10.011838 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8e3d2c39-0f9e-4c0c-a1da-5883ea88e619 req-57201ff0-aaee-4d36-8c58-08fe9ee6317a tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1729641
May 27 09:30:10.066493 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-b5f39f6e-db95-4c5e-99fc-411bca954cef req-eacabe3d-1980-4c56-91ad-92432d278d48 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0782330
May 27 09:30:10.086115 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfed74a-e0ad-4f73-a2ed-d0a64504603d req-a9273a19-b71c-4701-aa5b-2d80a55bf50a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:10.087866 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2bfed74a-e0ad-4f73-a2ed-d0a64504603d req-a9273a19-b71c-4701-aa5b-2d80a55bf50a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.3252161
May 27 09:30:10.259969 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2bfed74a-e0ad-4f73-a2ed-d0a64504603d req-db176029-e72b-4a80-88b9-62882f20d11b tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1633976
May 27 09:30:10.277782 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d {{(pid=91821) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:30:10.290119 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:10.312231 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Transition to ACTIVE for port object 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d will not be triggered until provisioned by entity L2. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:30:10.319871 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:10.327456 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:10.376010 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f85676a7-26b4-485d-88eb-60474afa458d req-56767b0c-2f6f-44c7-866a-474a7c795315 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:10.377536 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f85676a7-26b4-485d-88eb-60474afa458d req-56767b0c-2f6f-44c7-866a-474a7c795315 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.1962218
May 27 09:30:10.581355 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Pushing event updated for resources: {'Port': ['ID=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:10.585388 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:10.619904 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f85676a7-26b4-485d-88eb-60474afa458d req-021be56d-10fb-406a-a994-2167c46b94dc tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2313972
May 27 09:30:10.724171 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Attempting to bind port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:30:10.724512 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Attempting to bind port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:30:10.724846 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Attempting to bind port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d on network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:30:10.733714 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d on network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:30:10.734053 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Attempting to bind port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d on network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:30:10.745550 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 29, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:30:10.745899 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Checking segment: {'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:30:10.746295 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Bound using segment: {'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:30:10.746753 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Bound port: 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c23b4556-4fa1-45f3-b823-f454f9da8056', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 381, 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba'}}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:30:10.747109 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:10.774575 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-015f4d97-5eea-4118-b7ac-ff2f021b342d req-a447251c-89fa-47c6-af6f-e2d629448806 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:10.776189 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-015f4d97-5eea-4118-b7ac-ff2f021b342d req-a447251c-89fa-47c6-af6f-e2d629448806 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 945 time: 0.1600833
May 27 09:30:10.890711 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-015f4d97-5eea-4118-b7ac-ff2f021b342d req-c3f07225-799f-40e4-ad47-75f6d0504d6a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0881295
May 27 09:30:10.900518 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] For port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d, host hv-cinder-77262, cleared binding levels {{(pid=91821) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:30:10.903892 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] For port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91821) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:30:10.909951 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:10.915960 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-07462ed3-2bfe-49eb-a987-073e7ca617ef service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:10.976846 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:10.977554 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:10.978918 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] 10.222.0.11 "PUT /v2.0/ports/9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d HTTP/1.1" status: 200  len: 1093 time: 2.0240912
May 27 09:30:10.982420 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:30:11.026957 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Pushing event updated for resources: {'Port': ['ID=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,revision_number=3']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:11.030624 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:11.079658 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'status': 'completed', 'code': 200}
May 27 09:30:11.132421 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-191842a3-e72a-4334-9a9e-55387c005804 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:11.133956 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-191842a3-e72a-4334-9a9e-55387c005804 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a31154df1ce4420f9bdf53b8b3b3649e&device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 1096 time: 0.0965483
May 27 09:30:11.264980 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-dcde4749-8a41-4302-a8a2-d18499956390 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d HTTP/1.1" status: 200  len: 217 time: 0.1182642
May 27 09:30:11.375000 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-a9c5b8e3-efe1-4b88-9de3-18498f68d5b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:11.376661 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-a9c5b8e3-efe1-4b88-9de3-18498f68d5b5 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6659533b-b3b0-4d3c-8bf0-709a19b7728d HTTP/1.1" status: 200  len: 847 time: 0.0999506
May 27 09:30:11.434808 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8677d936-d802-495c-9422-794a6f34fdeb req-bc616f80-aadd-443d-8786-d7dc4983b1eb tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:11.443556 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8677d936-d802-495c-9422-794a6f34fdeb req-bc616f80-aadd-443d-8786-d7dc4983b1eb tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2995934
May 27 09:30:11.459557 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:11.571177 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8677d936-d802-495c-9422-794a6f34fdeb req-06bcb10b-3d2e-4244-9a57-4397f445c239 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1266880
May 27 09:30:11.606131 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-2a81b708-b207-42c8-aa12-a04b99786713 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:11.606131 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-2a81b708-b207-42c8-aa12-a04b99786713 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2201414
May 27 09:30:11.615207 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da84f434-e04f-414c-9ffd-91a490765bf0 req-0a56542f-d3fd-4e72-a227-99ba59fd33e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:11.616969 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-da84f434-e04f-414c-9ffd-91a490765bf0 req-0a56542f-d3fd-4e72-a227-99ba59fd33e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1652315
May 27 09:30:11.827655 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5a698895-c043-477c-a2bb-ea24b450e960 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:11.974339 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-da84f434-e04f-414c-9ffd-91a490765bf0 req-407f4f54-1a6b-48ae-8970-82d56ea19971 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.3347251
May 27 09:30:12.102976 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-8a2d70e4-0cc2-41bd-b7ae-d60988fc44d7 service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4833097
May 27 09:30:12.397602 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:12.398679 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e53c575-ee14-4793-8b71-2ac156014637 req-ee750d9d-69b1-48eb-9ff3-d98968f9f0f0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:12.406174 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5e53c575-ee14-4793-8b71-2ac156014637 req-ee750d9d-69b1-48eb-9ff3-d98968f9f0f0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.3839109
May 27 09:30:12.456071 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-608ceab1-7d3e-43a9-9b23-5a82b7d8260a req-bbcba7de-43d4-416b-8caa-5fd6fee8f0c8 service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3377275
May 27 09:30:12.530502 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5e53c575-ee14-4793-8b71-2ac156014637 req-0dc8f645-8ad2-4c99-a5f7-cb3c926459d9 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1219633
May 27 09:30:12.572177 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a198f1cf-160b-41ea-ad94-1a8ec828f871 req-b80541a9-84d8-4c96-92a0-221b2908b828 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:12.574509 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a198f1cf-160b-41ea-ad94-1a8ec828f871 req-b80541a9-84d8-4c96-92a0-221b2908b828 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 945 time: 0.3340843
May 27 09:30:12.845025 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a198f1cf-160b-41ea-ad94-1a8ec828f871 req-77871e05-b12b-4796-acf0-e5539473b863 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1811895
May 27 09:30:12.891546 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ffa88e7-e49c-4354-8864-eb89619d3f4f req-cfa387fa-b04d-4fa5-bc08-3389c43f5b4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:12.892186 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51104) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:12.893178 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1ffa88e7-e49c-4354-8864-eb89619d3f4f req-cfa387fa-b04d-4fa5-bc08-3389c43f5b4b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a31154df1ce4420f9bdf53b8b3b3649e&device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 1096 time: 0.3173935
May 27 09:30:12.934398 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95706c4c-cdf7-4148-b05f-f95b6a3e001c req-9690b505-ae6f-463c-8c01-2a2b1939b663 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:12.935924 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-95706c4c-cdf7-4148-b05f-f95b6a3e001c req-9690b505-ae6f-463c-8c01-2a2b1939b663 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.1902962
May 27 09:30:13.067982 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-95706c4c-cdf7-4148-b05f-f95b6a3e001c req-96ec9daf-2955-4eb8-aa47-8fae5b31d6af tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1245162
May 27 09:30:13.094468 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:13.107770 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ffa88e7-e49c-4354-8864-eb89619d3f4f req-f3ad026a-9f97-45a0-a4dc-1d1e7d623f22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:13.110700 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1ffa88e7-e49c-4354-8864-eb89619d3f4f req-f3ad026a-9f97-45a0-a4dc-1d1e7d623f22 service neutron] 10.222.0.11 "GET /v2.0/networks?id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba HTTP/1.1" status: 200  len: 909 time: 0.2080576
May 27 09:30:13.114523 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:13.119685 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Usage tracker for resource:security_group_rule and tenant:d60ba79cd619409c9af342788d278876 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:13.124911 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:13.132826 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:13.251280 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1ffa88e7-e49c-4354-8864-eb89619d3f4f req-c8f7440e-1644-458e-bcd9-966a861b84f8 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d HTTP/1.1" status: 200  len: 217 time: 0.1324658
May 27 09:30:13.259075 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:13.265541 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:13.301874 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f83d2088-c82a-488b-95a3-bfc9e385f71b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:13.384492 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=d60ba79cd619409c9af342788d278876&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4907324
May 27 09:30:13.385621 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51114) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:13.423053 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=716ec66b-5454-429e-9fb2-a99678299cf6,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:13.438366 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ffa88e7-e49c-4354-8864-eb89619d3f4f req-ae78c4cb-a736-4362-b948-aa45d34d745a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:13.440830 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1ffa88e7-e49c-4354-8864-eb89619d3f4f req-ae78c4cb-a736-4362-b948-aa45d34d745a service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6659533b-b3b0-4d3c-8bf0-709a19b7728d HTTP/1.1" status: 200  len: 847 time: 0.1236811
May 27 09:30:13.451490 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.452109 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.452705 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.453468 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.453913 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.454505 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.455084 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.456862 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.457691 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.458276 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.458871 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.459553 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:13.480883 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:13.540550 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17957b5e-4c10-4582-afc1-9ae7d36902c5 req-63b61954-6c7d-4e9a-803f-80f2cc430b8c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:13.542954 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-17957b5e-4c10-4582-afc1-9ae7d36902c5 req-63b61954-6c7d-4e9a-803f-80f2cc430b8c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2902422
May 27 09:30:13.569711 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d3d48dbe-9471-4833-bcb5-fae52cabc7d7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:13.607937 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d3d48dbe-9471-4833-bcb5-fae52cabc7d7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:13.639195 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-17957b5e-4c10-4582-afc1-9ae7d36902c5 req-cc9e0ee1-a352-4a47-a4a3-b56cfbad410e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0836074
May 27 09:30:13.689550 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ffa88e7-e49c-4354-8864-eb89619d3f4f req-eb1013fe-3a8b-4256-8eb5-48def2a92034 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:13.695750 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1ffa88e7-e49c-4354-8864-eb89619d3f4f req-eb1013fe-3a8b-4256-8eb5-48def2a92034 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2441604
May 27 09:30:13.698314 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d3d48dbe-9471-4833-bcb5-fae52cabc7d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:13.716109 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-35f73948-bdae-44fd-a3d0-de97e7fd3243 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:13.761352 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d48dbe-9471-4833-bcb5-fae52cabc7d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=716ec66b-5454-429e-9fb2-a99678299cf6,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:13.765852 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d3d48dbe-9471-4833-bcb5-fae52cabc7d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:13.773980 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d3d48dbe-9471-4833-bcb5-fae52cabc7d7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:13.791301 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-d3d48dbe-9471-4833-bcb5-fae52cabc7d7 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/716ec66b-5454-429e-9fb2-a99678299cf6 HTTP/1.1" status: 204  len: 168 time: 0.3882399
May 27 09:30:14.151479 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1ffa88e7-e49c-4354-8864-eb89619d3f4f req-37dadaa8-5618-4eee-8815-b3dc9b638394 service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4445505
May 27 09:30:14.198161 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7ee27fd-d931-4c44-a13f-e09827f8e1de req-9e80166e-6d9f-4524-a6b9-156a5fe1d0ab tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:14.206369 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e7ee27fd-d931-4c44-a13f-e09827f8e1de req-9e80166e-6d9f-4524-a6b9-156a5fe1d0ab tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.4399478
May 27 09:30:14.277566 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51136) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:14.305469 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-501e851d-b5a0-46c7-ac51-be83d41eba59 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:14.356509 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e7ee27fd-d931-4c44-a13f-e09827f8e1de req-0ffe3d13-116e-4705-9248-676709cfceca tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1492367
May 27 09:30:14.371243 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-501e851d-b5a0-46c7-ac51-be83d41eba59 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:14.386023 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-501e851d-b5a0-46c7-ac51-be83d41eba59 admin admin] Usage tracker for resource:security_group_rule and tenant:b0f3038327724a288883f78ed86aeb8c is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:14.390114 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b54cc28d-9f44-4345-a834-31e3a8f1d53e req-55eba50e-7ea4-4424-8909-18cb66472569 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:14.392499 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-501e851d-b5a0-46c7-ac51-be83d41eba59 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:14.398545 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b54cc28d-9f44-4345-a834-31e3a8f1d53e req-55eba50e-7ea4-4424-8909-18cb66472569 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.3124912
May 27 09:30:14.399933 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-501e851d-b5a0-46c7-ac51-be83d41eba59 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:14.441129 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1ffa88e7-e49c-4354-8864-eb89619d3f4f req-0255bdf8-2020-4b15-89b9-66d56ed5c9bd service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2806394
May 27 09:30:14.472995 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b54cc28d-9f44-4345-a834-31e3a8f1d53e req-89d61a13-a4af-4b27-869f-a6c59472c4d2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0705354
May 27 09:30:14.478132 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c580948-5338-4504-9f3e-c9c31377aabe req-ca4443af-3db5-402a-a51b-7bef84d50bb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:14.480618 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-7c580948-5338-4504-9f3e-c9c31377aabe req-ca4443af-3db5-402a-a51b-7bef84d50bb8 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 1098 time: 0.1579833
May 27 09:30:14.628337 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-501e851d-b5a0-46c7-ac51-be83d41eba59 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:14.648957 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-501e851d-b5a0-46c7-ac51-be83d41eba59 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:14.655781 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4dd8aa3c-a37c-499d-820d-a696daff0688 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:14.687293 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07aa0a85-1635-428e-832c-2411d9974852 req-f50032de-c395-4c41-b7c6-cb6ce20e1c50 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:14.688846 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-07aa0a85-1635-428e-832c-2411d9974852 req-f50032de-c395-4c41-b7c6-cb6ce20e1c50 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2112050
May 27 09:30:14.720381 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-501e851d-b5a0-46c7-ac51-be83d41eba59 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b0f3038327724a288883f78ed86aeb8c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4407394
May 27 09:30:14.723938 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51144) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:14.726453 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-501e851d-b5a0-46c7-ac51-be83d41eba59 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8e437c4b-84b0-4bcf-b164-65198d6b1306,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:14.730100 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c580948-5338-4504-9f3e-c9c31377aabe req-bd8ce266-0ea6-406b-89e5-235449673612 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:14.731590 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-7c580948-5338-4504-9f3e-c9c31377aabe req-bd8ce266-0ea6-406b-89e5-235449673612 service neutron] 10.222.0.11 "GET /v2.0/networks?id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 200  len: 912 time: 0.2423704
May 27 09:30:14.732424 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-501e851d-b5a0-46c7-ac51-be83d41eba59 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:14.762409 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-07aa0a85-1635-428e-832c-2411d9974852 req-0c23a4e7-43b0-4c07-9a9b-456490c31eb1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0612957
May 27 09:30:14.851046 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:30:14.901045 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-7c580948-5338-4504-9f3e-c9c31377aabe req-8c75eaf6-83bf-4765-ac74-5baa1d74849a service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5c6508e0-a5e3-49f0-adc0-fd87845be346 HTTP/1.1" status: 200  len: 1001 time: 0.1587803
May 27 09:30:15.000060 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:15.062937 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:15.085280 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'port_id': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'mac_address': 'fa:16:3e:70:e3:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 396, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:30:15.089903 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c580948-5338-4504-9f3e-c9c31377aabe req-b339259c-1d30-4a31-81ce-d3fa6e8ff469 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:15.091386 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-7c580948-5338-4504-9f3e-c9c31377aabe req-b339259c-1d30-4a31-81ce-d3fa6e8ff469 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b2c650ce-3329-4545-aaac-c69109472b2b HTTP/1.1" status: 200  len: 850 time: 0.1783693
May 27 09:30:15.152559 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:15.177293 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:30:15.209843 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3c70a994-0bf6-4185-a972-aa9a26ca20ba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:15.210844 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:15.224989 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:15.227325 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:15.255217 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c580948-5338-4504-9f3e-c9c31377aabe req-19569b47-9965-4d08-a6dc-3eb2c8d45ea8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:15.257565 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-7c580948-5338-4504-9f3e-c9c31377aabe req-19569b47-9965-4d08-a6dc-3eb2c8d45ea8 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1466737
May 27 09:30:15.258971 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3c70a994-0bf6-4185-a972-aa9a26ca20ba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:15.340179 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,revision_number=6']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:15.350385 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.350988 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.351539 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.352358 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.352878 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.353359 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.353849 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.354874 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.355392 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.355873 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.356352 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.357073 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:30:15.370287 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:15.391022 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['6c2d447f-c9da-40aa-a848-6fcbf0beecb3'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:30:15.485920 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3c70a994-0bf6-4185-a972-aa9a26ca20ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:15.503102 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:15.519778 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3c70a994-0bf6-4185-a972-aa9a26ca20ba admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:15.521158 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-3c70a994-0bf6-4185-a972-aa9a26ca20ba admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8e437c4b-84b0-4bcf-b164-65198d6b1306 HTTP/1.1" status: 204  len: 168 time: 0.7961144
May 27 09:30:15.525741 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-7c580948-5338-4504-9f3e-c9c31377aabe req-924acab3-4dcc-4c90-a68e-a3bd08e70ec7 service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2555161
May 27 09:30:15.527086 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c70a994-0bf6-4185-a972-aa9a26ca20ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8e437c4b-84b0-4bcf-b164-65198d6b1306,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:15.529616 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3c70a994-0bf6-4185-a972-aa9a26ca20ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:15.851006 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-7c580948-5338-4504-9f3e-c9c31377aabe req-8f0b4aa1-2e13-4477-8f27-b7fab985cf4c service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3153324
May 27 09:30:15.888920 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64dea5b3-3756-4d59-8baa-cb4ce184075c req-fff6bae4-7020-450d-872d-0e05b5c306d3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:15.905932 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-64dea5b3-3756-4d59-8baa-cb4ce184075c req-fff6bae4-7020-450d-872d-0e05b5c306d3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 945 time: 0.1889920
May 27 09:30:15.971535 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-64dea5b3-3756-4d59-8baa-cb4ce184075c req-4c8b8613-8984-4060-a49d-5206f224dbac tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0621948
May 27 09:30:16.014131 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-511daad8-2184-4d76-b5c8-6b7b8b491962 req-435a663b-f2f5-40fa-a57b-4ff729505330 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:16.016149 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-511daad8-2184-4d76-b5c8-6b7b8b491962 req-435a663b-f2f5-40fa-a57b-4ff729505330 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 1098 time: 0.1440694
May 27 09:30:16.142600 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41e7c693-c094-4bca-9ac2-1efd10f8b776 req-cfd1d0df-7a83-4b56-a980-3a7896e4d03e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:16.145483 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-41e7c693-c094-4bca-9ac2-1efd10f8b776 req-cfd1d0df-7a83-4b56-a980-3a7896e4d03e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1502337
May 27 09:30:16.221267 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-41e7c693-c094-4bca-9ac2-1efd10f8b776 req-f2ac0d88-012a-44e3-bb0b-c2d17ae6527b tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0627911
May 27 09:30:16.235054 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2291c58-976d-4f10-a56c-dad1ef5b75bf req-a5831893-db53-4902-bfcc-fbcd89e96daa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:16.237826 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f2291c58-976d-4f10-a56c-dad1ef5b75bf req-a5831893-db53-4902-bfcc-fbcd89e96daa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.1545627
May 27 09:30:16.297708 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-511daad8-2184-4d76-b5c8-6b7b8b491962 req-632d7350-56ab-4af9-89d8-f250d421beac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:16.300198 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-511daad8-2184-4d76-b5c8-6b7b8b491962 req-632d7350-56ab-4af9-89d8-f250d421beac service neutron] 10.222.0.11 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 920 time: 0.2768095
May 27 09:30:16.344384 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f2291c58-976d-4f10-a56c-dad1ef5b75bf req-c4bdc6c5-410d-4488-b9d5-7f75610736ad tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0855875
May 27 09:30:16.383589 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-511daad8-2184-4d76-b5c8-6b7b8b491962 req-480c48df-a786-4328-bfa1-9ac66316527d service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=61f95559-dc0a-4418-af09-fd9c84d973ac HTTP/1.1" status: 200  len: 217 time: 0.0760977
May 27 09:30:16.469163 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-511daad8-2184-4d76-b5c8-6b7b8b491962 req-61fa536c-e957-4d46-b794-2f7c2aa0e175 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:16.472181 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-511daad8-2184-4d76-b5c8-6b7b8b491962 req-61fa536c-e957-4d46-b794-2f7c2aa0e175 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac HTTP/1.1" status: 200  len: 859 time: 0.0713506
May 27 09:30:16.494064 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3504a0-d014-49f5-a093-592e4c294a5b req-801b7228-8530-4f58-91fa-7854c7d87530 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:16.501849 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7f3504a0-d014-49f5-a093-592e4c294a5b req-801b7228-8530-4f58-91fa-7854c7d87530 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1213465
May 27 09:30:16.527700 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-511daad8-2184-4d76-b5c8-6b7b8b491962 req-ea104223-89a6-46cc-b08f-8e20d941d7d0 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0486002
May 27 09:30:16.552708 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7f3504a0-d014-49f5-a093-592e4c294a5b req-9921ca61-e9da-4405-91ae-546c187e4597 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0490336
May 27 09:30:16.711961 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-511daad8-2184-4d76-b5c8-6b7b8b491962 req-958b35cc-21fd-4678-bfb6-5d76184a42f2 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1766253
May 27 09:30:16.870707 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:30:16.892588 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-511daad8-2184-4d76-b5c8-6b7b8b491962 req-11a69ff1-d0fa-4193-abd7-05dcd197e77f service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1715913
May 27 09:30:17.097457 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:30:17.097771 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:17.271438 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a75a6d0e-0190-4eb4-9608-1c0fc7124860 req-980b3c6f-e073-4ebc-8a7c-b0242d65b46f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:17.278890 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a75a6d0e-0190-4eb4-9608-1c0fc7124860 req-980b3c6f-e073-4ebc-8a7c-b0242d65b46f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 945 time: 0.1657999
May 27 09:30:17.332717 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a75a6d0e-0190-4eb4-9608-1c0fc7124860 req-9413adc6-4140-4588-b9a7-59a5c992f185 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0527177
May 27 09:30:17.336502 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:17.419722 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:30:17.456871 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:17.464675 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:17.469063 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-d680c48a-f893-44f7-8070-75d6bc36faa1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:17.650162 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52aca746-6251-405e-8018-ac5d129b83d2 req-a64de1b2-3cc7-42a3-adcd-65b2db9f6f8d tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:17.659573 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-52aca746-6251-405e-8018-ac5d129b83d2 req-a64de1b2-3cc7-42a3-adcd-65b2db9f6f8d tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2078192
May 27 09:30:17.727408 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,revision_number=7']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:17.739309 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.265s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:17.743513 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-52aca746-6251-405e-8018-ac5d129b83d2 req-06da5a17-dea3-4544-81ee-809b193c168e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0782883
May 27 09:30:17.762596 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68d1027f-1c84-49ce-8d55-f143fe345611 req-607fa8a9-964d-45cb-9e2c-b38525c072a9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:17.778066 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-68d1027f-1c84-49ce-8d55-f143fe345611 req-607fa8a9-964d-45cb-9e2c-b38525c072a9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2197371
May 27 09:30:17.945394 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-68d1027f-1c84-49ce-8d55-f143fe345611 req-a711534a-7180-4e2c-9121-7a3168d7d660 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1602144
May 27 09:30:17.958475 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'code': 200}
May 27 09:30:18.232102 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f75cf158-652d-42ac-b7ee-3bf5d839c6f2 req-d283fec8-9d2c-4252-85e0-692145843130 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:18.234793 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f75cf158-652d-42ac-b7ee-3bf5d839c6f2 req-d283fec8-9d2c-4252-85e0-692145843130 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1006734
May 27 09:30:18.333982 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f75cf158-652d-42ac-b7ee-3bf5d839c6f2 req-a8d8461b-95bb-4fbc-bdb3-dcddafbaeeac tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0909288
May 27 09:30:18.559508 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97f4cbcb-3699-4c60-bf9f-d1e38d8dafce req-85f20b85-bf86-4a08-8ffb-990e9376c15d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:18.561047 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-97f4cbcb-3699-4c60-bf9f-d1e38d8dafce req-85f20b85-bf86-4a08-8ffb-990e9376c15d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.0981829
May 27 09:30:18.629546 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-97f4cbcb-3699-4c60-bf9f-d1e38d8dafce req-0f9e079e-a58c-4502-be1d-37ecb2f6a4c6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0611563
May 27 09:30:19.208777 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51280) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:19.350263 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03834aa8-f37c-4bc0-817b-76c2c41e8cae req-de684740-48bc-4211-886a-e8093c5f4d7a tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:19.352323 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-03834aa8-f37c-4bc0-817b-76c2c41e8cae req-de684740-48bc-4211-886a-e8093c5f4d7a tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2311521
May 27 09:30:19.577326 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-03834aa8-f37c-4bc0-817b-76c2c41e8cae req-c19956fa-9a4e-4b9f-ab27-3c393207cef0 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2084150
May 27 09:30:19.635778 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-51dcb885-d332-4ca6-b1dc-0e8c30ab0d4b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:19.655885 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-51dcb885-d332-4ca6-b1dc-0e8c30ab0d4b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:19.661671 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-51dcb885-d332-4ca6-b1dc-0e8c30ab0d4b admin admin] Usage tracker for resource:security_group_rule and tenant:6506fbf9cfa8441798fc128661fa5e6b is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:19.665580 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-51dcb885-d332-4ca6-b1dc-0e8c30ab0d4b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:19.677505 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-51dcb885-d332-4ca6-b1dc-0e8c30ab0d4b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:19.711224 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d755000d-43a5-4b52-87ec-66fc7e309647 req-1e3552bb-976d-4de9-8079-3490e4a82001 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:19.719423 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d755000d-43a5-4b52-87ec-66fc7e309647 req-1e3552bb-976d-4de9-8079-3490e4a82001 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1618814
May 27 09:30:19.788921 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d755000d-43a5-4b52-87ec-66fc7e309647 req-133a7a83-1f1b-4f4b-a2b3-cf513c5f3963 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0682898
May 27 09:30:19.854376 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-51dcb885-d332-4ca6-b1dc-0e8c30ab0d4b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:19.864185 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-51dcb885-d332-4ca6-b1dc-0e8c30ab0d4b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:19.901990 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1019ad5e-98d3-4b16-a477-c18a0a87b341 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:19.942405 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-51dcb885-d332-4ca6-b1dc-0e8c30ab0d4b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6506fbf9cfa8441798fc128661fa5e6b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.7267244
May 27 09:30:19.942405 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51dcb885-d332-4ca6-b1dc-0e8c30ab0d4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=982a2111-80b5-4507-9ebd-726c412d2aaa,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:19.943914 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 51292) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:19.944498 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-51dcb885-d332-4ca6-b1dc-0e8c30ab0d4b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:20.235762 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7dccdb5a-5dae-4d3c-99af-26f6a05626b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:20.294952 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1f628ec-e3e9-47b8-8b07-c8feb0905d60 req-b1d7ee53-ed46-450a-87e2-18e6d51d129c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:20.296767 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d1f628ec-e3e9-47b8-8b07-c8feb0905d60 req-b1d7ee53-ed46-450a-87e2-18e6d51d129c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.2953820
May 27 09:30:20.306802 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7dccdb5a-5dae-4d3c-99af-26f6a05626b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:20.400892 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d1f628ec-e3e9-47b8-8b07-c8feb0905d60 req-d124f1b2-cd7f-4c20-bd96-c653b8398a01 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0789325
May 27 09:30:20.527474 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7dccdb5a-5dae-4d3c-99af-26f6a05626b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:20.528702 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dc608113-157d-41a3-a0aa-1a2564e59a9e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:20.544153 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dccdb5a-5dae-4d3c-99af-26f6a05626b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=982a2111-80b5-4507-9ebd-726c412d2aaa,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:20.551875 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7dccdb5a-5dae-4d3c-99af-26f6a05626b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:20.555915 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7dccdb5a-5dae-4d3c-99af-26f6a05626b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:20.560347 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-7dccdb5a-5dae-4d3c-99af-26f6a05626b9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/982a2111-80b5-4507-9ebd-726c412d2aaa HTTP/1.1" status: 204  len: 168 time: 0.6063688
May 27 09:30:21.033740 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ec00af3-97a0-46de-a7b7-afbe18a4e00c req-eb9fbbab-33dd-4b67-b58e-8c54824ee453 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:21.035488 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2ec00af3-97a0-46de-a7b7-afbe18a4e00c req-eb9fbbab-33dd-4b67-b58e-8c54824ee453 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2155869
May 27 09:30:21.106325 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6e149d-2361-4b9d-949a-8d948a2e5449 req-18e4344b-511d-4e5a-a505-2ba734f6b0e5 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:21.108003 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4b6e149d-2361-4b9d-949a-8d948a2e5449 req-18e4344b-511d-4e5a-a505-2ba734f6b0e5 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1585975
May 27 09:30:21.119552 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2ec00af3-97a0-46de-a7b7-afbe18a4e00c req-574a58f2-afd2-496b-8b2b-9d55d9ffa48c tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0687418
May 27 09:30:21.210079 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4b6e149d-2361-4b9d-949a-8d948a2e5449 req-4a1e85b2-c26a-4440-84f1-67e8ae155211 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0847275
May 27 09:30:21.220351 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 51310) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:21.255260 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7fb0a986-e710-4fe7-bd8e-811debba7927 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:21.278990 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-7fb0a986-e710-4fe7-bd8e-811debba7927 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:21.286404 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-7fb0a986-e710-4fe7-bd8e-811debba7927 admin admin] Usage tracker for resource:security_group_rule and tenant:b12620c332ca4d1a835dcf7c7b115313 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:21.291105 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-7fb0a986-e710-4fe7-bd8e-811debba7927 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:21.302571 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-7fb0a986-e710-4fe7-bd8e-811debba7927 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:21.495201 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7fb0a986-e710-4fe7-bd8e-811debba7927 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:21.503512 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7fb0a986-e710-4fe7-bd8e-811debba7927 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:21.532028 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-41a049bc-9c3c-448a-a1f1-1d95695c132b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:21.638577 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb0a986-e710-4fe7-bd8e-811debba7927 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c60ae200-137e-4a81-8659-726e61c45248,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:21.641898 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7fb0a986-e710-4fe7-bd8e-811debba7927 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:21.646439 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-7fb0a986-e710-4fe7-bd8e-811debba7927 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b12620c332ca4d1a835dcf7c7b115313&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4240737
May 27 09:30:21.650976 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 51316) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:21.877727 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3eef9b6b-9f27-4e0d-a4a3-002c94a465f0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:21.912932 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3eef9b6b-9f27-4e0d-a4a3-002c94a465f0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:21.970244 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a1ce985-ee27-4278-a723-3424d33e3f0d req-ffcafcea-1d5d-4e37-ac15-d41529c06f6c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:21.974179 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7a1ce985-ee27-4278-a723-3424d33e3f0d req-ffcafcea-1d5d-4e37-ac15-d41529c06f6c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.1800449
May 27 09:30:22.043729 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7a1ce985-ee27-4278-a723-3424d33e3f0d req-d533ea60-64cd-4e41-8430-054eee271492 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0531514
May 27 09:30:22.044698 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3eef9b6b-9f27-4e0d-a4a3-002c94a465f0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:22.055426 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-13541cea-bf01-4631-9c3d-851713410c57 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:22.072120 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3eef9b6b-9f27-4e0d-a4a3-002c94a465f0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c60ae200-137e-4a81-8659-726e61c45248,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:22.075938 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3eef9b6b-9f27-4e0d-a4a3-002c94a465f0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:22.079301 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-3eef9b6b-9f27-4e0d-a4a3-002c94a465f0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c60ae200-137e-4a81-8659-726e61c45248 HTTP/1.1" status: 204  len: 168 time: 0.4249210
May 27 09:30:22.079301 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-3eef9b6b-9f27-4e0d-a4a3-002c94a465f0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:22.445452 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7056ecc7-11e6-46e7-80bc-aaaa1e3c4e9a req-afad63d6-6779-497c-89d1-f4b99343fb11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:22.447081 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7056ecc7-11e6-46e7-80bc-aaaa1e3c4e9a req-afad63d6-6779-497c-89d1-f4b99343fb11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.1684408
May 27 09:30:22.512666 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7056ecc7-11e6-46e7-80bc-aaaa1e3c4e9a req-232a9bb6-30c7-4ee5-9430-be02ede68d65 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0595543
May 27 09:30:22.549948 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01e42500-d930-4bc4-b323-3b6dfd76f0b0 req-62c8d499-8b53-48d3-82b3-f32f0af0d952 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:22.560812 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-01e42500-d930-4bc4-b323-3b6dfd76f0b0 req-62c8d499-8b53-48d3-82b3-f32f0af0d952 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1852922
May 27 09:30:22.639626 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-01e42500-d930-4bc4-b323-3b6dfd76f0b0 req-22b7b638-2997-4894-ab72-71ace3ab7242 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0758142
May 27 09:30:23.362315 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64197d7a-ecc1-4094-bf95-207c699c9038 req-19ed2052-71cb-4392-92be-1175b5a054d3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:23.363856 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-64197d7a-ecc1-4094-bf95-207c699c9038 req-19ed2052-71cb-4392-92be-1175b5a054d3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.1435859
May 27 09:30:23.442002 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-64197d7a-ecc1-4094-bf95-207c699c9038 req-23d90ce8-2c6e-44bb-bead-7a3623e68d89 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0702224
May 27 09:30:23.804533 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcade4c2-ba34-4fe1-9914-1813e29866ef req-fe204454-4632-41be-9bc7-b9808c355f6d tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:23.807206 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dcade4c2-ba34-4fe1-9914-1813e29866ef req-fe204454-4632-41be-9bc7-b9808c355f6d tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.1304467
May 27 09:30:23.925206 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dcade4c2-ba34-4fe1-9914-1813e29866ef req-a143ea8f-43d4-4d40-82ce-401a0f2a50bf tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0749483
May 27 09:30:23.972005 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e3bc77f-9124-43f6-b0b6-67ccd12b3d08 req-81015af0-cc30-454b-a496-d7ffe11be40d tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:23.973535 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8e3bc77f-9124-43f6-b0b6-67ccd12b3d08 req-81015af0-cc30-454b-a496-d7ffe11be40d tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1650558
May 27 09:30:23.999265 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-a675896c-fd50-4f00-9ede-b6904eb32b3e service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1323063
May 27 09:30:24.039506 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8e3bc77f-9124-43f6-b0b6-67ccd12b3d08 req-56b5da0e-f712-4b88-967a-dc40bf619198 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0595009
May 27 09:30:24.141360 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-3a0b4f46-13b6-4807-a4fe-ecb845f7f92a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:24.143889 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-3a0b4f46-13b6-4807-a4fe-ecb845f7f92a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 1098 time: 0.1104259
May 27 09:30:24.350989 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-6fe7841c-bbca-41d8-aaf5-f51431e218aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:24.354360 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-6fe7841c-bbca-41d8-aaf5-f51431e218aa service neutron] 10.222.0.11 "GET /v2.0/networks?id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 200  len: 912 time: 0.1776874
May 27 09:30:24.563845 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-f96c000a-b84f-448d-b796-eb7cdf40b490 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5c6508e0-a5e3-49f0-adc0-fd87845be346 HTTP/1.1" status: 200  len: 1001 time: 0.1990333
May 27 09:30:24.710331 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-6090aa78-441f-4997-9d3e-6ee554cba04b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:24.712978 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-6090aa78-441f-4997-9d3e-6ee554cba04b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b2c650ce-3329-4545-aaac-c69109472b2b HTTP/1.1" status: 200  len: 850 time: 0.1394997
May 27 09:30:24.945630 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-416fa49b-15ad-4394-9e6e-962f8c678c1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:24.949651 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-416fa49b-15ad-4394-9e6e-962f8c678c1f service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2251287
May 27 09:30:25.089674 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18ed8157-bf55-4965-aadb-c153893910ca req-d402e66c-4368-4d8d-aeb5-1ee8a0a42f8e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:25.093285 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-18ed8157-bf55-4965-aadb-c153893910ca req-d402e66c-4368-4d8d-aeb5-1ee8a0a42f8e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.3523655
May 27 09:30:25.222628 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-18ed8157-bf55-4965-aadb-c153893910ca req-1cf15276-b207-46b0-97a9-db8f5828469d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1218140
May 27 09:30:25.248210 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-b4ffe0e9-fa63-4bf4-bb4f-deec55946c2a service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2812607
May 27 09:30:25.541390 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e9346d-af42-48f1-9949-346896a680c2 req-7dc8606e-8412-4a83-a750-6f9c68ec8931 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:25.551831 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-83e9346d-af42-48f1-9949-346896a680c2 req-7dc8606e-8412-4a83-a750-6f9c68ec8931 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.3124080
May 27 09:30:25.630251 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3359dcd0-8b84-4c59-a260-d2b2fd73ab4d req-1f4bb64f-e457-4972-a084-97c44541bd8c service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3660290
May 27 09:30:25.654798 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-83e9346d-af42-48f1-9949-346896a680c2 req-5604b857-baaa-4b69-ace4-d34d68a48444 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1016209
May 27 09:30:25.703950 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-279bfd73-582c-4857-84e8-5cb4c74f8100 req-078519a6-8ba3-4204-afab-3bf6fbc193e6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:25.711534 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-279bfd73-582c-4857-84e8-5cb4c74f8100 req-078519a6-8ba3-4204-afab-3bf6fbc193e6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.2839990
May 27 09:30:25.788816 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-279bfd73-582c-4857-84e8-5cb4c74f8100 req-7e35bbea-2553-4d09-972c-dd0ea4fcf9aa tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0762992
May 27 09:30:26.403752 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:26.434083 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 51430) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:26.755034 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-233d64ed-c195-4496-9c42-a951ff964c7d req-a567ca6d-7a0a-421d-a53d-94cb962c0fa5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:26.762866 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-233d64ed-c195-4496-9c42-a951ff964c7d req-a567ca6d-7a0a-421d-a53d-94cb962c0fa5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.2443624
May 27 09:30:26.812833 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d0435a63-4424-4080-9fe5-24c5b277bba1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:26.848475 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d0435a63-4424-4080-9fe5-24c5b277bba1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:26.864238 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-d0435a63-4424-4080-9fe5-24c5b277bba1 admin admin] Usage tracker for resource:security_group_rule and tenant:2cfca1b43e6d4d2db22ad4bc8507e27b is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:26.945978 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-d0435a63-4424-4080-9fe5-24c5b277bba1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:26.958347 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-233d64ed-c195-4496-9c42-a951ff964c7d req-2e98d1ad-3161-4c69-aab9-a19c352e5f80 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1943805
May 27 09:30:26.975450 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d0435a63-4424-4080-9fe5-24c5b277bba1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:27.074801 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b7ccedf-9249-43a8-a4b6-9d4dc7d50c43 req-29304273-eb5a-4df5-930f-d5743e65e97b tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:27.076539 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0b7ccedf-9249-43a8-a4b6-9d4dc7d50c43 req-29304273-eb5a-4df5-930f-d5743e65e97b tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2240818
May 27 09:30:27.216234 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0b7ccedf-9249-43a8-a4b6-9d4dc7d50c43 req-9044cc57-2779-4c89-b6a5-7f5b96e025bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1284935
May 27 09:30:27.220077 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d0435a63-4424-4080-9fe5-24c5b277bba1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:27.237460 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d0435a63-4424-4080-9fe5-24c5b277bba1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:27.250725 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:27.342147 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-d0435a63-4424-4080-9fe5-24c5b277bba1 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2cfca1b43e6d4d2db22ad4bc8507e27b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9025993
May 27 09:30:27.342147 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0435a63-4424-4080-9fe5-24c5b277bba1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07a60c13-c56f-40a6-8f21-13bce43b9763,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:27.342730 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51444) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:27.369489 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-d0435a63-4424-4080-9fe5-24c5b277bba1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:27.407615 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b833c09-1153-496b-a4e9-11043e8a40f7 req-9f7d1940-c87d-4eab-ba84-f334f191b9a0 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:27.407615 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b833c09-1153-496b-a4e9-11043e8a40f7 req-9f7d1940-c87d-4eab-ba84-f334f191b9a0 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.2439582
May 27 09:30:27.464732 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2dc3fa9a-427a-4923-9d05-b24f4b3a741a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:27.485670 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b833c09-1153-496b-a4e9-11043e8a40f7 req-16d80a6a-79c1-4474-9370-dbddcb13086d tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0714343
May 27 09:30:27.518349 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2dc3fa9a-427a-4923-9d05-b24f4b3a741a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:27.648792 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2dc3fa9a-427a-4923-9d05-b24f4b3a741a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:27.653428 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8e8341e7-11b7-42e0-b5fb-966f712fd765 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:27.683671 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dc3fa9a-427a-4923-9d05-b24f4b3a741a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07a60c13-c56f-40a6-8f21-13bce43b9763,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:27.686579 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2dc3fa9a-427a-4923-9d05-b24f4b3a741a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:27.719824 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2dc3fa9a-427a-4923-9d05-b24f4b3a741a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:27.722195 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-2dc3fa9a-427a-4923-9d05-b24f4b3a741a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/07a60c13-c56f-40a6-8f21-13bce43b9763 HTTP/1.1" status: 204  len: 168 time: 0.3773746
May 27 09:30:28.318827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c3e6516-f0a1-4db3-8009-648fad62d5b2 req-90ab2fe8-7a95-47bd-913a-b2e414a39264 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:28.320914 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3c3e6516-f0a1-4db3-8009-648fad62d5b2 req-90ab2fe8-7a95-47bd-913a-b2e414a39264 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.1051168
May 27 09:30:28.440975 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51468) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:28.441636 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3c3e6516-f0a1-4db3-8009-648fad62d5b2 req-59b9a2cd-9c72-4b52-bd5c-59e249688738 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1080542
May 27 09:30:28.501469 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-43b17fb2-dc47-4cb3-9539-2e5917636633 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:28.523915 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-43b17fb2-dc47-4cb3-9539-2e5917636633 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:28.529301 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-43b17fb2-dc47-4cb3-9539-2e5917636633 admin admin] Usage tracker for resource:security_group_rule and tenant:a1292d2cb2d64659922f28c900714d1c is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:28.532908 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-43b17fb2-dc47-4cb3-9539-2e5917636633 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:28.540674 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-43b17fb2-dc47-4cb3-9539-2e5917636633 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:28.597700 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3257c8f-1f76-47c7-9205-55aa1eaa25a8 req-8131bb6c-2653-4b06-8663-f8e7d521ec60 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:28.606114 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c3257c8f-1f76-47c7-9205-55aa1eaa25a8 req-8131bb6c-2653-4b06-8663-f8e7d521ec60 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.1626019
May 27 09:30:28.664872 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c3257c8f-1f76-47c7-9205-55aa1eaa25a8 req-38fcc05a-104f-486a-8ca9-a9df174ae9f5 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0577054
May 27 09:30:28.742809 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-43b17fb2-dc47-4cb3-9539-2e5917636633 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:28.749541 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-43b17fb2-dc47-4cb3-9539-2e5917636633 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:28.765783 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3b576228-2def-4002-939a-dc17457a6619 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:28.782002 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24008d51-396d-41c3-9062-fe31668797c7 req-7c63b60c-8424-45ae-a7cb-8289924922b0 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:28.785480 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-24008d51-396d-41c3-9062-fe31668797c7 req-7c63b60c-8424-45ae-a7cb-8289924922b0 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1025732
May 27 09:30:28.832222 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-43b17fb2-dc47-4cb3-9539-2e5917636633 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a1292d2cb2d64659922f28c900714d1c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3849266
May 27 09:30:28.832222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43b17fb2-dc47-4cb3-9539-2e5917636633 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1bf67a3d-a191-459a-906e-fa8dcbbed689,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:28.833295 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51474) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:28.836022 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-43b17fb2-dc47-4cb3-9539-2e5917636633 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:28.862115 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-24008d51-396d-41c3-9062-fe31668797c7 req-7e937ff1-317a-4892-a3ae-2515b41c3eb5 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0618947
May 27 09:30:28.992443 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e4b7eadb-097f-44ed-ab4b-6b39ad73f592 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:29.037047 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e4b7eadb-097f-44ed-ab4b-6b39ad73f592 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:29.143774 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e4b7eadb-097f-44ed-ab4b-6b39ad73f592 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:29.150404 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d3d48dbe-9471-4833-bcb5-fae52cabc7d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:29.176653 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b7eadb-097f-44ed-ab4b-6b39ad73f592 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1bf67a3d-a191-459a-906e-fa8dcbbed689,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:29.182127 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e4b7eadb-097f-44ed-ab4b-6b39ad73f592 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:29.186150 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e4b7eadb-097f-44ed-ab4b-6b39ad73f592 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:29.192276 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-e4b7eadb-097f-44ed-ab4b-6b39ad73f592 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/1bf67a3d-a191-459a-906e-fa8dcbbed689 HTTP/1.1" status: 204  len: 168 time: 0.3537076
May 27 09:30:29.981434 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3485ad6-9f7f-4ded-8c05-c6668ddfaee9 req-05c9f524-3f04-475f-8586-5b1ef21839fa tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:29.987807 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b3485ad6-9f7f-4ded-8c05-c6668ddfaee9 req-05c9f524-3f04-475f-8586-5b1ef21839fa tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.3221166
May 27 09:30:30.056803 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01b7c719-6cfe-485a-9995-4015039068d9 req-88a1f200-5e02-4aa7-a088-def868f3fa07 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:30.064111 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-01b7c719-6cfe-485a-9995-4015039068d9 req-88a1f200-5e02-4aa7-a088-def868f3fa07 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2075727
May 27 09:30:30.093925 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b3485ad6-9f7f-4ded-8c05-c6668ddfaee9 req-480fd093-c697-41d3-bc40-d8da6a911c1e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0963535
May 27 09:30:30.186435 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-01b7c719-6cfe-485a-9995-4015039068d9 req-d91f69be-ec2b-45a6-8be1-7c36737fbb8c tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1156154
May 27 09:30:30.379393 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-538530b1-24e9-412e-b758-700ee74a3f1f req-bbb9f86e-1cc9-4cd5-835c-ba14cf4ab02b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:30.380988 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-538530b1-24e9-412e-b758-700ee74a3f1f req-bbb9f86e-1cc9-4cd5-835c-ba14cf4ab02b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1392152
May 27 09:30:30.466911 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-538530b1-24e9-412e-b758-700ee74a3f1f req-f1536c64-be1b-40ee-94d5-dc436edd60ff tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0756187
May 27 09:30:31.630481 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-431fd8bc-67b4-460f-bf15-bc04f0629025 req-8525d46f-0b22-4035-8aa0-ad17b47d69d4 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:31.638527 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-431fd8bc-67b4-460f-bf15-bc04f0629025 req-8525d46f-0b22-4035-8aa0-ad17b47d69d4 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2203772
May 27 09:30:31.713121 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-431fd8bc-67b4-460f-bf15-bc04f0629025 req-6df378ef-74d1-413b-b8d4-575c5e03df93 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0735471
May 27 09:30:31.718366 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51534) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:31.737549 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96c9c1e6-5db5-455c-b6a3-556a5e360f0a req-a08a1e5d-eb42-425a-8aa6-17b4da621f41 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:31.746281 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-96c9c1e6-5db5-455c-b6a3-556a5e360f0a req-a08a1e5d-eb42-425a-8aa6-17b4da621f41 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.2630067
May 27 09:30:31.813265 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-96c9c1e6-5db5-455c-b6a3-556a5e360f0a req-933c1e68-0b71-4587-8081-bc49541e4659 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0659049
May 27 09:30:32.108974 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6104b9-7405-4a2b-8a88-5b58dca4e3d1 req-34e189a5-cf52-43c2-bcb6-a2986a2c32a0 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:32.117914 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-da6104b9-7405-4a2b-8a88-5b58dca4e3d1 req-34e189a5-cf52-43c2-bcb6-a2986a2c32a0 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1940548
May 27 09:30:32.244874 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b71e44b3-5c2e-41eb-b708-c19fee1ec99a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:32.245332 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-da6104b9-7405-4a2b-8a88-5b58dca4e3d1 req-b2a99844-61ed-461b-98cb-3c674ff28f35 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1139534
May 27 09:30:32.290049 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-b71e44b3-5c2e-41eb-b708-c19fee1ec99a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:32.297408 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-b71e44b3-5c2e-41eb-b708-c19fee1ec99a admin admin] Usage tracker for resource:security_group_rule and tenant:46d0462a55ef49c78544bff6bbcaabc7 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:32.304098 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-b71e44b3-5c2e-41eb-b708-c19fee1ec99a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:32.316874 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-b71e44b3-5c2e-41eb-b708-c19fee1ec99a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:32.510900 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b71e44b3-5c2e-41eb-b708-c19fee1ec99a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:32.518090 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b71e44b3-5c2e-41eb-b708-c19fee1ec99a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:32.535778 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:32.614462 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-b71e44b3-5c2e-41eb-b708-c19fee1ec99a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=46d0462a55ef49c78544bff6bbcaabc7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8914020
May 27 09:30:32.615173 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 51560) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:32.634850 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b71e44b3-5c2e-41eb-b708-c19fee1ec99a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=500423ca-0ffb-408f-929c-c2fbefa4ae2a,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:32.645731 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b71e44b3-5c2e-41eb-b708-c19fee1ec99a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:32.748226 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d9314885-0453-40b4-ad4d-907e2538f614 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:32.817749 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d9314885-0453-40b4-ad4d-907e2538f614 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:32.967740 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d9314885-0453-40b4-ad4d-907e2538f614 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:33.003438 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-684c4e6c-45c7-497f-a1a6-41a5cd7381ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:33.045529 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d9314885-0453-40b4-ad4d-907e2538f614 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:33.048154 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-d9314885-0453-40b4-ad4d-907e2538f614 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/500423ca-0ffb-408f-929c-c2fbefa4ae2a HTTP/1.1" status: 204  len: 168 time: 0.4307544
May 27 09:30:33.050813 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9314885-0453-40b4-ad4d-907e2538f614 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=500423ca-0ffb-408f-929c-c2fbefa4ae2a,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:33.057761 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-d9314885-0453-40b4-ad4d-907e2538f614 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:33.410835 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc86e8b3-efda-42df-85a9-517319de11b7 req-888160bd-69ea-4f7e-aa80-8a154aeb57d5 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:33.418277 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bc86e8b3-efda-42df-85a9-517319de11b7 req-888160bd-69ea-4f7e-aa80-8a154aeb57d5 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.3747637
May 27 09:30:33.500551 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51580) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:33.573256 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60783b26-a1ba-4921-986b-dc3dacce354e req-e629a71e-bd37-43f4-9e51-1505ac39aac2 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:33.578288 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-60783b26-a1ba-4921-986b-dc3dacce354e req-e629a71e-bd37-43f4-9e51-1505ac39aac2 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.3707700
May 27 09:30:33.584322 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bc86e8b3-efda-42df-85a9-517319de11b7 req-a58f853f-5dd9-405d-a7a6-b91050ef16a6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1485319
May 27 09:30:33.747935 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-60783b26-a1ba-4921-986b-dc3dacce354e req-0ef0fb5b-a5cd-4f0d-9473-0ab70ae1d709 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1542501
May 27 09:30:34.041203 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-146cabc6-e3ef-4bf2-888b-bf10ea024270 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:34.089245 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-146cabc6-e3ef-4bf2-888b-bf10ea024270 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:34.097195 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-146cabc6-e3ef-4bf2-888b-bf10ea024270 admin admin] Usage tracker for resource:security_group_rule and tenant:b0937426c77e4aeab624823c4450582f is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:34.101763 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-146cabc6-e3ef-4bf2-888b-bf10ea024270 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:34.121165 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-146cabc6-e3ef-4bf2-888b-bf10ea024270 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:34.124151 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9723cf1a-6ed3-47bc-986e-42e8cbe9f844 req-94009b24-8c4f-4544-a69c-04c4e309b3c6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:34.124648 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9723cf1a-6ed3-47bc-986e-42e8cbe9f844 req-94009b24-8c4f-4544-a69c-04c4e309b3c6 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.2766044
May 27 09:30:34.254592 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9723cf1a-6ed3-47bc-986e-42e8cbe9f844 req-429dfcac-ad54-4b98-bd7f-39720600d021 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1131284
May 27 09:30:34.355039 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-146cabc6-e3ef-4bf2-888b-bf10ea024270 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:34.364733 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-146cabc6-e3ef-4bf2-888b-bf10ea024270 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:34.376236 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a34e3c28-2763-4df8-a0de-4c88b7d51ad3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:34.394767 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781f1f1f-835a-48ff-96bc-096f4aeb0118 req-ff35f593-0b21-40c2-8bad-6442b9d0a8ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:34.397606 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-781f1f1f-835a-48ff-96bc-096f4aeb0118 req-ff35f593-0b21-40c2-8bad-6442b9d0a8ea service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 1098 time: 0.4428577
May 27 09:30:34.490219 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-146cabc6-e3ef-4bf2-888b-bf10ea024270 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b0937426c77e4aeab624823c4450582f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9882927
May 27 09:30:34.494910 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 51614) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:34.503514 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-146cabc6-e3ef-4bf2-888b-bf10ea024270 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5c7d7fb5-f337-41b2-bbb2-ea7de78c494e,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:34.510489 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-146cabc6-e3ef-4bf2-888b-bf10ea024270 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:34.539094 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-781f1f1f-835a-48ff-96bc-096f4aeb0118 req-e290a4b7-1f05-40a1-874e-c87ed0757ef8 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1233871
May 27 09:30:34.602081 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2e72e42f-9233-4522-9f7f-91fb5bd1327f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:34.655862 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2e72e42f-9233-4522-9f7f-91fb5bd1327f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:34.702011 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51622) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:34.775306 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2e72e42f-9233-4522-9f7f-91fb5bd1327f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:34.780681 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a0012642-c1fd-46c8-87ed-127ccbcd25a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:34.796290 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e72e42f-9233-4522-9f7f-91fb5bd1327f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5c7d7fb5-f337-41b2-bbb2-ea7de78c494e,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:34.801940 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-2e72e42f-9233-4522-9f7f-91fb5bd1327f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:34.809452 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2e72e42f-9233-4522-9f7f-91fb5bd1327f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:34.811859 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-2e72e42f-9233-4522-9f7f-91fb5bd1327f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/5c7d7fb5-f337-41b2-bbb2-ea7de78c494e HTTP/1.1" status: 204  len: 168 time: 0.3151023
May 27 09:30:35.116363 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec8f959-b85e-4d1a-9234-cbafafc25882 req-998e4d66-0f86-40e1-bcc1-dc6eb5ae4073 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:35.126694 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dec8f959-b85e-4d1a-9234-cbafafc25882 req-998e4d66-0f86-40e1-bcc1-dc6eb5ae4073 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2775960
May 27 09:30:35.157974 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958d29a0-3bdb-493c-a980-244e6e6ff8bb req-aa3cab9a-5580-48d2-809c-1c9af15f2051 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:35.161051 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-958d29a0-3bdb-493c-a980-244e6e6ff8bb req-aa3cab9a-5580-48d2-809c-1c9af15f2051 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 1099 time: 0.1569371
May 27 09:30:35.282365 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dec8f959-b85e-4d1a-9234-cbafafc25882 req-88284b39-2039-4945-94a3-cc78ebdbbc41 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1529899
May 27 09:30:35.315015 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ddf5fd-3d79-4dd2-b643-f1d1032e64bd req-131b1a28-353d-44ea-b4bf-9af3a12ed9f3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:35.326191 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d8ddf5fd-3d79-4dd2-b643-f1d1032e64bd req-131b1a28-353d-44ea-b4bf-9af3a12ed9f3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.3507037
May 27 09:30:35.377272 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958d29a0-3bdb-493c-a980-244e6e6ff8bb req-cb032f28-82a4-4489-ba16-c7abd9cc6dd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:35.379224 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-958d29a0-3bdb-493c-a980-244e6e6ff8bb req-cb032f28-82a4-4489-ba16-c7abd9cc6dd3 service neutron] 10.222.0.11 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 917 time: 0.2106731
May 27 09:30:35.384902 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1961379002-network', 'tenant_id': 'ea51e621877d47f29b60bce5258df734'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:30:35.391335 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:35.397235 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Usage tracker for resource:network and tenant:ea51e621877d47f29b60bce5258df734 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:35.401375 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:35.411071 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:35.451023 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d8ddf5fd-3d79-4dd2-b643-f1d1032e64bd req-ed01f61c-9a2f-4366-b64d-21d60f5e0239 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1057196
May 27 09:30:35.546173 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-958d29a0-3bdb-493c-a980-244e6e6ff8bb req-f924cb36-9d06-426c-a821-90351ca7a2a7 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3 HTTP/1.1" status: 200  len: 1001 time: 0.1256979
May 27 09:30:35.567674 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Made reservation on behalf of ea51e621877d47f29b60bce5258df734 for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:30:35.567674 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:35.724027 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958d29a0-3bdb-493c-a980-244e6e6ff8bb req-f657281b-d9f9-494a-b90f-f78033a97e9e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:35.725546 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-958d29a0-3bdb-493c-a980-244e6e6ff8bb req-f657281b-d9f9-494a-b90f-f78033a97e9e service neutron] 10.222.0.11 "GET /v2.0/subnets?id=77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 200  len: 855 time: 0.1310699
May 27 09:30:35.728444 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:35.747915 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:35.753152 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Usage tracker for resource:security_group_rule and tenant:ea51e621877d47f29b60bce5258df734 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:35.756555 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:35.767689 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:35.823414 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 51638) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:35.856979 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-55d46913-abd7-4c33-9d85-68fa18a10aad admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:35.906535 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-55d46913-abd7-4c33-9d85-68fa18a10aad admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:35.917941 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-55d46913-abd7-4c33-9d85-68fa18a10aad admin admin] Usage tracker for resource:security_group_rule and tenant:b34314e510154ed49bee5c3564f9470c is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:35.921795 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-55d46913-abd7-4c33-9d85-68fa18a10aad admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:35.931475 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-55d46913-abd7-4c33-9d85-68fa18a10aad admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:35.971002 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4270f493-1fdb-492f-86fd-e717aa4b5e9e req-ab985a8b-b065-4d91-a38f-99f2595cd9da tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:35.974734 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4270f493-1fdb-492f-86fd-e717aa4b5e9e req-ab985a8b-b065-4d91-a38f-99f2595cd9da tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.2442400
May 27 09:30:36.041358 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-958d29a0-3bdb-493c-a980-244e6e6ff8bb req-b671d129-6769-4228-b57b-79552467bf9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:36.044420 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-958d29a0-3bdb-493c-a980-244e6e6ff8bb req-b671d129-6769-4228-b57b-79552467bf9c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=624aa867-a71e-4343-8899-4e49257cd000&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3011360
May 27 09:30:36.192890 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4270f493-1fdb-492f-86fd-e717aa4b5e9e req-87280396-81dc-4f70-94cd-3c5534b820e9 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1992338
May 27 09:30:36.205820 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-55d46913-abd7-4c33-9d85-68fa18a10aad admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.216666 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.222339 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-55d46913-abd7-4c33-9d85-68fa18a10aad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.231554 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.239237 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:36.250437 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0ef55008-b603-4694-90a2-38f3ea076834 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:36.296651 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] vlan segment allocate from pool success with {'vlan_id': 363, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:30:36.342430 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=153060e3-7aa0-458d-9022-cda03d192fae,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:36.363762 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-55d46913-abd7-4c33-9d85-68fa18a10aad admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b34314e510154ed49bee5c3564f9470c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5402083
May 27 09:30:36.369583 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 51644) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:36.374543 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:36.380696 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-958d29a0-3bdb-493c-a980-244e6e6ff8bb req-d3a7a65c-d418-422d-91bc-412ce0723764 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3227568
May 27 09:30:36.385431 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.386353 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Added segment 111bd85e-76cc-4ba7-8f48-b8ddd0684287 of type vlan for network 7a08fef5-d013-4fc8-8260-e3fd96453634
May 27 09:30:36.414070 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55d46913-abd7-4c33-9d85-68fa18a10aad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b3e017b7-e96c-4213-8634-bb4d8bf259f7,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:36.427067 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-55d46913-abd7-4c33-9d85-68fa18a10aad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:36.482301 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b21d2a14-bf07-4355-b668-5135d7c109e0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.523719 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b21d2a14-bf07-4355-b668-5135d7c109e0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.609001 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.696532 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.700728 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:36.701375 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.706932 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54dcca71-31ed-40d4-a904-f3c1779cf613 req-bdc01e0f-50c4-4a4d-9f6a-a7bd25b6f737 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:36.715093 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-54dcca71-31ed-40d4-a904-f3c1779cf613 req-bdc01e0f-50c4-4a4d-9f6a-a7bd25b6f737 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.1600652
May 27 09:30:36.722751 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-01672016-c66c-4be5-9a7b-46a7c5cd6c16 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:36.739511 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b21d2a14-bf07-4355-b668-5135d7c109e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.748551 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:36.865844 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-958d29a0-3bdb-493c-a980-244e6e6ff8bb req-6af0ee4b-b855-4402-abae-aee6a008fe51 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4632242
May 27 09:30:36.881688 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Pushing event updated for resources: {'Network': ['ID=7a08fef5-d013-4fc8-8260-e3fd96453634,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:36.905144 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 2.1966417
May 27 09:30:36.905144 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:36.905596 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51652) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:36.937022 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 7a08fef5-d013-4fc8-8260-e3fd96453634 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:30:36.942221 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b21d2a14-bf07-4355-b668-5135d7c109e0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:36.942901 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Request body: {'subnet': {'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1961379002-subnet', 'tenant_id': 'ea51e621877d47f29b60bce5258df734', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:30:36.947603 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-b21d2a14-bf07-4355-b668-5135d7c109e0 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b3e017b7-e96c-4213-8634-bb4d8bf259f7 HTTP/1.1" status: 204  len: 168 time: 0.5762892
May 27 09:30:36.957284 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b21d2a14-bf07-4355-b668-5135d7c109e0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b3e017b7-e96c-4213-8634-bb4d8bf259f7,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:36.985528 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-b21d2a14-bf07-4355-b668-5135d7c109e0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:36.998506 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:37.002100 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Usage tracker for resource:subnet and tenant:ea51e621877d47f29b60bce5258df734 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:37.018447 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:37.020409 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-54dcca71-31ed-40d4-a904-f3c1779cf613 req-f20c0d5b-3546-41d3-a95f-49fe8a6d6637 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3042865
May 27 09:30:37.063963 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:37.091450 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Made reservation on behalf of ea51e621877d47f29b60bce5258df734 for: {'subnet': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:30:37.094405 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2490007'] for subnet, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:37.112077 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09d4cbb-889f-4ca7-b867-2f71b09cad15 req-37209aa6-b0e8-4d74-9248-b06b16e6501e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:37.127006 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e09d4cbb-889f-4ca7-b867-2f71b09cad15 req-37209aa6-b0e8-4d74-9248-b06b16e6501e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.3790116
May 27 09:30:37.233742 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e09d4cbb-889f-4ca7-b867-2f71b09cad15 req-8ba09616-c1f3-4d98-b8f2-7bcf4b79ace0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1024425
May 27 09:30:37.600660 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4befa7e-f2ea-4224-a51c-703300b676ae req-e3c4b1a4-1a0b-40ff-a1dc-684d1ece11f5 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:37.609970 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c4befa7e-f2ea-4224-a51c-703300b676ae req-e3c4b1a4-1a0b-40ff-a1dc-684d1ece11f5 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1787961
May 27 09:30:37.716434 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c4befa7e-f2ea-4224-a51c-703300b676ae req-32c93ba1-7704-4743-a94e-7d04f9c0b2e0 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1053267
May 27 09:30:37.920447 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2421472', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2489985'] for subnet, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:37.929353 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:38.116129 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:30:38.117943 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Checking segment: {'id': '111bd85e-76cc-4ba7-8f48-b8ddd0684287', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:30:38.117943 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Network hostable DHCP agents. Network: 7a08fef5-d013-4fc8-8260-e3fd96453634, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91820) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:30:38.155361 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Pushing event updated for resources: {'Subnet': ['ID=b5e42a76-0f30-4445-a1f6-5d4cc78bf42c,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:38.182398 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:38.201151 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Network 7a08fef5-d013-4fc8-8260-e3fd96453634 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91820) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:30:38.223113 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 7a08fef5-d013-4fc8-8260-e3fd96453634) {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:30:38.238403 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94a139fe-803b-407f-9bda-9b6c19678085 None None] Network 7a08fef5-d013-4fc8-8260-e3fd96453634 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:30:38.239654 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:38.240874 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:38.271592 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 851 time: 1.3631260
May 27 09:30:38.578190 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-c71d873e-b658-4cf8-97aa-6b452d023730 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:38.653374 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad33cce7-ffdf-4d19-acb9-ea32f26fb60c req-d20d8f54-e091-4a93-8694-380d689fe2fb tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:38.691853 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ad33cce7-ffdf-4d19-acb9-ea32f26fb60c req-d20d8f54-e091-4a93-8694-380d689fe2fb tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.3250365
May 27 09:30:38.973812 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ad33cce7-ffdf-4d19-acb9-ea32f26fb60c req-3884485b-d91d-4d9b-985d-bd8c3ab4606f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2793796
May 27 09:30:39.023612 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:30:39.129446 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c49d55cb-38f2-4a87-ba82-895201a1f149 req-6d266f37-5ee1-4c34-92d0-07186789c008 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:39.146799 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c49d55cb-38f2-4a87-ba82-895201a1f149 req-6d266f37-5ee1-4c34-92d0-07186789c008 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=e165c54223b24166b6856b6f285c4bca&device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 1098 time: 0.3731897
May 27 09:30:39.167545 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fc75866b-6380-481c-b89d-f8a8d6b9a0ce None None] Network 7a08fef5-d013-4fc8-8260-e3fd96453634 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:30:39.302923 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be17e48f-582b-4676-bd26-44519f5e0747 req-77bdc170-a6a0-4218-ab06-0843abda8029 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:39.315923 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-be17e48f-582b-4676-bd26-44519f5e0747 req-77bdc170-a6a0-4218-ab06-0843abda8029 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 946 time: 0.2540569
May 27 09:30:39.653389 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-be17e48f-582b-4676-bd26-44519f5e0747 req-ec9630eb-156a-4cff-ad53-f84380b6ba2f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3328171
May 27 09:30:39.727751 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c49d55cb-38f2-4a87-ba82-895201a1f149 req-77540edb-6d5b-403f-b500-396829b3667b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:39.738513 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c49d55cb-38f2-4a87-ba82-895201a1f149 req-77540edb-6d5b-403f-b500-396829b3667b service neutron] 10.222.0.11 "GET /v2.0/networks?id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 200  len: 920 time: 0.5842314
May 27 09:30:39.895324 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:39.906318 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-629f740c-6325-4996-8c1d-fc182a50fd39 req-e27447cf-e83e-4e63-bb52-f103810ddc36 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:39.906658 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c49d55cb-38f2-4a87-ba82-895201a1f149 req-a2028964-849d-4deb-998a-c84cc53c2625 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=61f95559-dc0a-4418-af09-fd9c84d973ac HTTP/1.1" status: 200  len: 217 time: 0.1597707
May 27 09:30:39.935762 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-629f740c-6325-4996-8c1d-fc182a50fd39 req-e27447cf-e83e-4e63-bb52-f103810ddc36 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.4574430
May 27 09:30:40.071859 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:30:40.116914 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:40.129690 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:40.132683 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-086f1751-f1fd-466f-8976-1e74cd1820e1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:40.136457 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c49d55cb-38f2-4a87-ba82-895201a1f149 req-9752e00c-bf63-4492-8362-20a7b9fb56a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:40.139911 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-629f740c-6325-4996-8c1d-fc182a50fd39 req-5ddfbd39-b53f-4695-a037-d1dc9ad71cda tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1980591
May 27 09:30:40.140914 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c49d55cb-38f2-4a87-ba82-895201a1f149 req-9752e00c-bf63-4492-8362-20a7b9fb56a2 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac HTTP/1.1" status: 200  len: 859 time: 0.2251844
May 27 09:30:40.279006 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c49d55cb-38f2-4a87-ba82-895201a1f149 req-2df8bc16-3aa1-4911-ad02-27a4a45352fb service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=ca288a2a-9fc5-474b-a3f5-732ddd5ede80&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.1139505
May 27 09:30:40.324060 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,revision_number=8']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:40.331553 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.198s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:40.372979 dv-cinder-772623-6-iscsi neutron-server[91822]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'code': 422} returned with failed status
May 27 09:30:40.574491 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c49d55cb-38f2-4a87-ba82-895201a1f149 req-19d1637a-b3b3-4d0f-98a8-2675088ef0c5 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2938206
May 27 09:30:40.593323 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9396fc09-eba1-4faf-b2ad-f5a6f4ba31a6 req-0038d5b7-369f-4c0e-9074-9703fac4a9ff tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:40.608868 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9396fc09-eba1-4faf-b2ad-f5a6f4ba31a6 req-0038d5b7-369f-4c0e-9074-9703fac4a9ff tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2051103
May 27 09:30:40.724975 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9396fc09-eba1-4faf-b2ad-f5a6f4ba31a6 req-2dca23b3-485a-4b9a-8a89-38fdb7fd8dd4 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1146302
May 27 09:30:40.840627 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c49d55cb-38f2-4a87-ba82-895201a1f149 req-b1c63c43-8ccc-4d1d-b3d3-c23b99fb2006 service neutron] 10.222.0.11 "GET /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2564151
May 27 09:30:41.058045 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1adfd3f8-b90c-44c1-b361-8478ac923fa0 req-84f36ed1-7998-4e05-8670-ed8c8bb4426b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:41.063409 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1adfd3f8-b90c-44c1-b361-8478ac923fa0 req-84f36ed1-7998-4e05-8670-ed8c8bb4426b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.1341867
May 27 09:30:41.146704 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1adfd3f8-b90c-44c1-b361-8478ac923fa0 req-619f59d4-efce-486b-86b4-79542afedd55 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0755534
May 27 09:30:41.506940 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:41.594375 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2130193e-ea61-4d2b-877a-7ad7faa08acf req-0830747f-dd00-46d2-b4e7-5b28f2a557fd tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:41.604021 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2130193e-ea61-4d2b-877a-7ad7faa08acf req-0830747f-dd00-46d2-b4e7-5b28f2a557fd tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1789689
May 27 09:30:41.696209 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2130193e-ea61-4d2b-877a-7ad7faa08acf req-7e5e5a59-c732-41cd-a382-1cdc186d976e tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0853975
May 27 09:30:41.841503 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-9ca30e57-ad57-41c8-975f-2ff0c1bc7520 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:42.129663 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2299fc5-5c73-44f6-8124-bc70cadccdf5 req-c5232dec-cf84-4836-93f8-d48be78ff571 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:42.145178 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e2299fc5-5c73-44f6-8124-bc70cadccdf5 req-c5232dec-cf84-4836-93f8-d48be78ff571 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.1838605
May 27 09:30:42.222140 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e2299fc5-5c73-44f6-8124-bc70cadccdf5 req-9d7fcd58-5f18-49ac-a935-32a697ebd673 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0680521
May 27 09:30:42.388675 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:42.598628 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-9880c24d-cb9b-4d85-aad1-5b67d248861e tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:42.605714 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-9880c24d-cb9b-4d85-aad1-5b67d248861e tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/networks?id=7a08fef5-d013-4fc8-8260-e3fd96453634 HTTP/1.1" status: 200  len: 814 time: 0.2747035
May 27 09:30:42.634397 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-6052ae38-3271-4d3c-96b5-617830410100 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/quotas/ea51e621877d47f29b60bce5258df734 HTTP/1.1" status: 200  len: 375 time: 0.0209861
May 27 09:30:42.694483 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-465e35f5-a06d-4ee9-bcee-e72f63bbb12a tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=ea51e621877d47f29b60bce5258df734&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0588698
May 27 09:30:43.018615 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:30:43.021615 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:30:43.070055 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-3ef700f1-8980-48f0-b643-eb92eb45b59a service neutron] 10.222.0.30 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3670814
May 27 09:30:43.506172 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.db.resource_extend [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] It took 0.25 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}}
May 27 09:30:43.816609 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-86e090bb-1fae-4aa2-9572-f8349ed4bc85 service neutron] 10.222.0.30 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.6978819
May 27 09:30:43.876319 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:43.913163 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c5bce6d-2673-40da-96bb-2fe522eb9eac req-c1dd6daa-35a1-4c36-927a-ec460b13d616 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:43.934129 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4c5bce6d-2673-40da-96bb-2fe522eb9eac req-c1dd6daa-35a1-4c36-927a-ec460b13d616 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.4887650
May 27 09:30:43.952719 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'port_id': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'mac_address': 'fa:16:3e:80:f5:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:30:44.132384 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4c5bce6d-2673-40da-96bb-2fe522eb9eac req-360796ce-9cd7-4860-9401-c5289893f79f tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1962321
May 27 09:30:44.134491 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:44.192865 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:30:44.250320 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:44.261268 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:44.266160 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:44.321192 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 51820) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:44.526781 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:44.532651 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:44.605203 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:30:44.809427 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d92fdf76-b711-4e00-b4cb-379fa604d389 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:44.861681 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d92fdf76-b711-4e00-b4cb-379fa604d389 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:44.890920 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-d92fdf76-b711-4e00-b4cb-379fa604d389 admin admin] Usage tracker for resource:security_group_rule and tenant:a18b6cf7a38d46d0b4373770831b1351 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:44.900658 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-d92fdf76-b711-4e00-b4cb-379fa604d389 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:44.932662 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d92fdf76-b711-4e00-b4cb-379fa604d389 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:44.976801 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:45.012345 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce41a938-4891-48df-9a1a-70722ed607c7 req-e914e143-b352-499a-a45f-58e9bcd1d4a7 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:45.014269 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ce41a938-4891-48df-9a1a-70722ed607c7 req-e914e143-b352-499a-a45f-58e9bcd1d4a7 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 944 time: 0.4482076
May 27 09:30:45.036895 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b133692-2cf3-4520-ae20-96073af03cb9 req-dafea609-67c5-4f4e-b9bf-955d869afb8b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:45.045144 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b133692-2cf3-4520-ae20-96073af03cb9 req-dafea609-67c5-4f4e-b9bf-955d869afb8b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.5367882
May 27 09:30:45.249200 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51844) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:45.342064 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ce41a938-4891-48df-9a1a-70722ed607c7 req-0f5e91fd-1cd7-47cb-b4d0-9d3419bc5f78 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1574719
May 27 09:30:45.402333 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b133692-2cf3-4520-ae20-96073af03cb9 req-a5da6427-7eb2-4976-82a0-2368082309d5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3505185
May 27 09:30:45.626521 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-10b99610-4738-489d-a932-8e8cb714f4ec req-e5c65ef7-47b4-4390-94ba-c167fd479a6a service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.3726602
May 27 09:30:45.638509 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d92fdf76-b711-4e00-b4cb-379fa604d389 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:45.647691 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d92fdf76-b711-4e00-b4cb-379fa604d389 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:45.655138 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-d9314885-0453-40b4-ad4d-907e2538f614 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:45.711584 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-d92fdf76-b711-4e00-b4cb-379fa604d389 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a18b6cf7a38d46d0b4373770831b1351&name=default HTTP/1.1" status: 200  len: 2979 time: 1.3886886
May 27 09:30:45.713036 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d92fdf76-b711-4e00-b4cb-379fa604d389 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ceb23c11-f9d7-449b-b3ac-6112e5c7798d,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:45.715708 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 51852) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:45.728834 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-d92fdf76-b711-4e00-b4cb-379fa604d389 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:45.860798 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-abd2b2c1-8648-41bc-9541-23a0478056f0 req-bb45d21e-8ea8-45dd-bffc-892b6dfe24bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 210 time: 0.0859604
May 27 09:30:45.894365 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2fab837b-7021-4dbe-bafd-7ef395f54a3a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:45.982551 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2fab837b-7021-4dbe-bafd-7ef395f54a3a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:46.128158 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2fab837b-7021-4dbe-bafd-7ef395f54a3a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:46.150070 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e242922b-e621-4469-93fe-76eef2e4eff5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:46.183696 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fab837b-7021-4dbe-bafd-7ef395f54a3a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ceb23c11-f9d7-449b-b3ac-6112e5c7798d,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:46.191406 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2fab837b-7021-4dbe-bafd-7ef395f54a3a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:46.194347 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2fab837b-7021-4dbe-bafd-7ef395f54a3a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:46.202844 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-2fab837b-7021-4dbe-bafd-7ef395f54a3a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ceb23c11-f9d7-449b-b3ac-6112e5c7798d HTTP/1.1" status: 204  len: 168 time: 0.4847662
May 27 09:30:46.336923 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c5e502-5fee-4248-a139-242c12e35428 req-e2c4e369-c647-492e-8245-9140c8b20f05 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:46.342178 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-83c5e502-5fee-4248-a139-242c12e35428 req-e2c4e369-c647-492e-8245-9140c8b20f05 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1706288
May 27 09:30:46.532569 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-83c5e502-5fee-4248-a139-242c12e35428 req-78e240de-512f-4bd2-9d90-4e997e2df1bd tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1832099
May 27 09:30:46.877697 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fad59a50-f10c-49f4-b2dd-86c70c6897bf req-4429abc0-bc86-495b-9a13-47e51b47a1d7 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:46.882543 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fad59a50-f10c-49f4-b2dd-86c70c6897bf req-4429abc0-bc86-495b-9a13-47e51b47a1d7 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 944 time: 0.1957784
May 27 09:30:47.042055 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:30:47.162515 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fad59a50-f10c-49f4-b2dd-86c70c6897bf req-680570e2-4501-44be-8da5-e38696062741 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2629626
May 27 09:30:47.238784 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 51882) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:47.275979 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:30:47.291197 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:30:47.291822 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:47.369835 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25df0473-7ca4-4769-aa77-2857be58a5aa req-3193cda1-7a56-4d28-9411-daa54d49d657 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:47.384778 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-703ce978-4842-4501-8626-442a16d11344 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:47.385542 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-703ce978-4842-4501-8626-442a16d11344 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Synchronizing usage tracker for tenant:ea51e621877d47f29b60bce5258df734 on resource:network {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:30:47.398958 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-25df0473-7ca4-4769-aa77-2857be58a5aa req-3193cda1-7a56-4d28-9411-daa54d49d657 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.4667838
May 27 09:30:47.426429 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-703ce978-4842-4501-8626-442a16d11344 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Unset dirty status for tenant:ea51e621877d47f29b60bce5258df734 on resource:network {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:30:47.429676 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-703ce978-4842-4501-8626-442a16d11344 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.11 "GET /v2.0/networks?id=7a08fef5-d013-4fc8-8260-e3fd96453634 HTTP/1.1" status: 200  len: 814 time: 0.6426497
May 27 09:30:47.454149 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Request body: {'port': {'device_id': '1c33bed6-7082-470c-b880-7efb7cf09e91', 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634', 'admin_state_up': True, 'tenant_id': 'ea51e621877d47f29b60bce5258df734'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:30:47.528038 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0017aa45-5b7b-4c48-a289-a304ac8c3461 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:47.609933 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-002a3ef1-7e51-4fd3-9a6e-8c6ee114c0c2 req-0a93bda7-cae6-4f37-8e9c-74a31de6fd12 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 210 time: 0.1635971
May 27 09:30:47.671007 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0017aa45-5b7b-4c48-a289-a304ac8c3461 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:47.686309 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0017aa45-5b7b-4c48-a289-a304ac8c3461 admin admin] Usage tracker for resource:security_group_rule and tenant:da733004c1374f32a811323bb7420ca5 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:47.693339 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0017aa45-5b7b-4c48-a289-a304ac8c3461 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:47.703289 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0017aa45-5b7b-4c48-a289-a304ac8c3461 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:47.718057 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-25df0473-7ca4-4769-aa77-2857be58a5aa req-fde99778-9d69-44a7-a57f-a9539800dda3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1919265
May 27 09:30:47.723356 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:47.792163 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:47.796529 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:30:47.802856 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Usage tracker for resource:port and tenant:ea51e621877d47f29b60bce5258df734 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:47.823538 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:47.827619 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:47.836742 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:47.839830 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:47.866600 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:47.901974 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Made reservation on behalf of ea51e621877d47f29b60bce5258df734 for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:30:47.907019 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:47.953167 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'code': 200}
May 27 09:30:47.989147 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0017aa45-5b7b-4c48-a289-a304ac8c3461 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:48.001320 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0017aa45-5b7b-4c48-a289-a304ac8c3461 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:48.035625 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:48.039119 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:48.084592 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-3eef9b6b-9f27-4e0d-a4a3-002c94a465f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:48.108990 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-0017aa45-5b7b-4c48-a289-a304ac8c3461 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=da733004c1374f32a811323bb7420ca5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8662279
May 27 09:30:48.109839 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 51898) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:48.223838 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0017aa45-5b7b-4c48-a289-a304ac8c3461 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eec9ae0d-3f0f-4897-9d10-ac07a4aea389,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:48.231073 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0017aa45-5b7b-4c48-a289-a304ac8c3461 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:48.338771 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a4a91f7d-da49-4710-aa4c-16fdbcf69535 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:48.344710 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Allocated IP 172.20.0.12 (7a08fef5-d013-4fc8-8260-e3fd96453634/b5e42a76-0f30-4445-a1f6-5d4cc78bf42c/4c74ea48-9f46-439c-96c3-0cfd268e3274) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:30:48.489276 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a4a91f7d-da49-4710-aa4c-16fdbcf69535 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:48.690497 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a4a91f7d-da49-4710-aa4c-16fdbcf69535 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:48.704520 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-d92fdf76-b711-4e00-b4cb-379fa604d389 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:48.740595 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4a91f7d-da49-4710-aa4c-16fdbcf69535 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eec9ae0d-3f0f-4897-9d10-ac07a4aea389,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:48.743874 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a4a91f7d-da49-4710-aa4c-16fdbcf69535 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:48.747881 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a4a91f7d-da49-4710-aa4c-16fdbcf69535 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:48.753894 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-a4a91f7d-da49-4710-aa4c-16fdbcf69535 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/eec9ae0d-3f0f-4897-9d10-ac07a4aea389 HTTP/1.1" status: 204  len: 168 time: 0.6347539
May 27 09:30:48.783398 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b13b2b-aa2c-48da-8d65-940b2ecf4b20 req-808c604b-d1c8-4bde-b234-680063e84a60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:48.785466 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-45b13b2b-aa2c-48da-8d65-940b2ecf4b20 req-808c604b-d1c8-4bde-b234-680063e84a60 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 1098 time: 0.3749325
May 27 09:30:48.916474 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:48.955122 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:48.959432 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffed07a3-4e7b-481a-8d42-8be413784f5a req-72235afc-9d8b-4de3-bade-1ac9803b4ad9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:48.967422 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:48.970546 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ffed07a3-4e7b-481a-8d42-8be413784f5a req-72235afc-9d8b-4de3-bade-1ac9803b4ad9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.4438243
May 27 09:30:48.994907 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3380cbde-1be9-48c9-a49b-edf13e7e745b req-5a6080c8-2513-4dc6-9847-9e0e1497018b tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 210 time: 0.1121504
May 27 09:30:49.101722 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-45b13b2b-aa2c-48da-8d65-940b2ecf4b20 req-dbc76a34-b02b-4b6a-be60-a5c34efd6199 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2919366
May 27 09:30:49.120383 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Network 7a08fef5-d013-4fc8-8260-e3fd96453634 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:30:49.123947 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:30:49.134899 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ffed07a3-4e7b-481a-8d42-8be413784f5a req-d6d6c5fe-f216-42db-a4d6-c3c3df0fb070 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1631293
May 27 09:30:49.138878 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:30:49.222887 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Pushing event updated for resources: {'Port': ['ID=4c74ea48-9f46-439c-96c3-0cfd268e3274,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:49.242257 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.275s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:49.273047 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:49.274477 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:49.373145 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.9306750
May 27 09:30:49.413472 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Request body: {'port': {'device_id': '1c33bed6-7082-470c-b880-7efb7cf09e91', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:30:49.528501 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58218e4c-241a-4a58-86eb-537d8ebced21 req-356c8161-9210-4459-baad-4fac80f76815 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:49.530715 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-58218e4c-241a-4a58-86eb-537d8ebced21 req-356c8161-9210-4459-baad-4fac80f76815 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.3130767
May 27 09:30:49.635353 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-58218e4c-241a-4a58-86eb-537d8ebced21 req-46eb7d31-f634-4324-82f5-394c0984ea97 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0861707
May 27 09:30:49.652258 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:50.341403 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4c74ea48-9f46-439c-96c3-0cfd268e3274 {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:30:50.365789 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:50.390449 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Transition to ACTIVE for port object 4c74ea48-9f46-439c-96c3-0cfd268e3274 will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:30:50.398592 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:50.416500 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c147e8ef-3761-4581-b241-d0793c33ae8d tempest-DeleteServersTestJSON-483119838 tempest-DeleteServersTestJSON-483119838-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:50.547942 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Pushing event updated for resources: {'Port': ['ID=4c74ea48-9f46-439c-96c3-0cfd268e3274,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:50.610993 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:50.647877 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4fb95c0-1ce9-48ae-807d-47b7471c72e1 req-4a28f0ce-c7d4-4ec4-bc74-7f0a99d4ace3 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:50.650354 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b4fb95c0-1ce9-48ae-807d-47b7471c72e1 req-4a28f0ce-c7d4-4ec4-bc74-7f0a99d4ace3 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 932 time: 0.5173500
May 27 09:30:50.713438 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b99610-4738-489d-a932-8e8cb714f4ec req-b697bdb3-fc54-4b92-b030-2ced69cf7ce5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:50.714982 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10b99610-4738-489d-a932-8e8cb714f4ec req-b697bdb3-fc54-4b92-b030-2ced69cf7ce5 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd&tenant_id=f631f0ceb250483891019fb79b2e6b83 HTTP/1.1" status: 200  len: 1097 time: 0.2606862
May 27 09:30:50.724313 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8309a88-5515-4c33-a0e0-63941b7bed95 req-2b528346-048b-4605-bb1b-4849102a2a98 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:50.725888 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a8309a88-5515-4c33-a0e0-63941b7bed95 req-2b528346-048b-4605-bb1b-4849102a2a98 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.3506005
May 27 09:30:50.860769 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Attempting to bind port 4c74ea48-9f46-439c-96c3-0cfd268e3274 on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:30:50.862532 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Attempting to bind port 4c74ea48-9f46-439c-96c3-0cfd268e3274 by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '111bd85e-76cc-4ba7-8f48-b8ddd0684287', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:30:50.862532 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Attempting to bind port 4c74ea48-9f46-439c-96c3-0cfd268e3274 on network 7a08fef5-d013-4fc8-8260-e3fd96453634 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:30:50.871000 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Port 4c74ea48-9f46-439c-96c3-0cfd268e3274 on network 7a08fef5-d013-4fc8-8260-e3fd96453634 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:30:50.871638 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Attempting to bind port 4c74ea48-9f46-439c-96c3-0cfd268e3274 on network 7a08fef5-d013-4fc8-8260-e3fd96453634 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:30:50.876582 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b4fb95c0-1ce9-48ae-807d-47b7471c72e1 req-0a695564-9798-4097-a41e-34909b855c11 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2112083
May 27 09:30:50.883399 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 30, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:30:50.885331 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Checking segment: {'id': '111bd85e-76cc-4ba7-8f48-b8ddd0684287', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:30:50.886015 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Bound using segment: {'id': '111bd85e-76cc-4ba7-8f48-b8ddd0684287', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:30:50.886782 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Bound port: 4c74ea48-9f46-439c-96c3-0cfd268e3274, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '111bd85e-76cc-4ba7-8f48-b8ddd0684287', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:30:50.887361 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:50.965885 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a8309a88-5515-4c33-a0e0-63941b7bed95 req-1be6e540-856d-4765-a732-dd4aa2a7cc12 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2268190
May 27 09:30:51.066110 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b99610-4738-489d-a932-8e8cb714f4ec req-2ffb400b-f4f9-4702-8117-710cb2774e72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:51.079168 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10b99610-4738-489d-a932-8e8cb714f4ec req-2ffb400b-f4f9-4702-8117-710cb2774e72 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 1097 time: 0.2815166
May 27 09:30:51.169042 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] For port 4c74ea48-9f46-439c-96c3-0cfd268e3274, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:30:51.176072 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] For port 4c74ea48-9f46-439c-96c3-0cfd268e3274, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=4c74ea48-9f46-439c-96c3-0cfd268e3274,segment=NetworkSegment(111bd85e-76cc-4ba7-8f48-b8ddd0684287),segment_id=111bd85e-76cc-4ba7-8f48-b8ddd0684287)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:30:51.184740 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:51.210860 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:51.297130 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:51.298142 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:51.300231 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] 10.222.0.11 "PUT /v2.0/ports/4c74ea48-9f46-439c-96c3-0cfd268e3274 HTTP/1.1" status: 200  len: 1094 time: 1.9123039
May 27 09:30:51.301411 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c33bed6-7082-470c-b880-7efb7cf09e91', 'tag': '4c74ea48-9f46-439c-96c3-0cfd268e3274'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:30:51.396715 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b99610-4738-489d-a932-8e8cb714f4ec req-afdc6d65-6845-4b04-a5fc-1c7007266316 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:51.399277 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10b99610-4738-489d-a932-8e8cb714f4ec req-afdc6d65-6845-4b04-a5fc-1c7007266316 service neutron] 10.222.0.11 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 917 time: 0.3176296
May 27 09:30:51.461703 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Pushing event updated for resources: {'Port': ['ID=4c74ea48-9f46-439c-96c3-0cfd268e3274,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:51.466683 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.256s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:51.490257 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-84ff634c-ba8f-4bd4-b3d9-497756f79fe9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:51.492115 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-84ff634c-ba8f-4bd4-b3d9-497756f79fe9 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=ea51e621877d47f29b60bce5258df734&device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 1097 time: 0.1395509
May 27 09:30:51.497938 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c33bed6-7082-470c-b880-7efb7cf09e91', 'tag': '4c74ea48-9f46-439c-96c3-0cfd268e3274', 'status': 'completed', 'code': 200}
May 27 09:30:51.714376 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-d5e9b113-714d-4833-ac42-7867d3245863 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4c74ea48-9f46-439c-96c3-0cfd268e3274 HTTP/1.1" status: 200  len: 217 time: 0.1899323
May 27 09:30:51.839018 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-8d0c4180-2216-403c-a7f3-a3ed52ca6933 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:51.841871 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-8d0c4180-2216-403c-a7f3-a3ed52ca6933 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b5e42a76-0f30-4445-a1f6-5d4cc78bf42c HTTP/1.1" status: 200  len: 854 time: 0.1157176
May 27 09:30:51.869321 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10b99610-4738-489d-a932-8e8cb714f4ec req-615548b9-a81f-4c57-81c1-445bd843a6d0 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3 HTTP/1.1" status: 200  len: 999 time: 0.4054174
May 27 09:30:51.936714 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-1c0af4a3-e6c5-4074-b655-eb01d149d5a1 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7a08fef5-d013-4fc8-8260-e3fd96453634&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0845187
May 27 09:30:51.969500 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7879a7b-1480-468f-9b76-478c66005dad req-342bc3cb-3da5-485c-807b-c79c1af5ae7f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:51.973643 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e7879a7b-1480-468f-9b76-478c66005dad req-342bc3cb-3da5-485c-807b-c79c1af5ae7f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.5723407
May 27 09:30:52.129031 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b99610-4738-489d-a932-8e8cb714f4ec req-b516928c-7564-47c4-b183-4e58f19e489d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:52.129776 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-eb0d8641-bd86-4472-b419-30eb289a1574 service neutron] 10.222.0.11 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1791053
May 27 09:30:52.130474 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10b99610-4738-489d-a932-8e8cb714f4ec req-b516928c-7564-47c4-b183-4e58f19e489d service neutron] 10.222.0.11 "GET /v2.0/subnets?id=77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 200  len: 855 time: 0.2484696
May 27 09:30:52.137021 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e7879a7b-1480-468f-9b76-478c66005dad req-a01d63ca-2e0a-4bff-ab72-f4305f05cf49 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0968001
May 27 09:30:52.261567 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e6aae2d-a1f7-4ba8-8efa-ccb57a2a0b4f req-06d219c1-f171-4ca3-af0f-5ce9ae5aeb5a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:52.263197 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1e6aae2d-a1f7-4ba8-8efa-ccb57a2a0b4f req-06d219c1-f171-4ca3-af0f-5ce9ae5aeb5a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 945 time: 0.3675334
May 27 09:30:52.402534 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f4b1ef9c-a530-4bd5-9ae5-c193c797417b req-19b0fd6a-1d23-4fd7-a0cc-6dd3ae16f836 service neutron] 10.222.0.11 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2537684
May 27 09:30:52.404756 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b99610-4738-489d-a932-8e8cb714f4ec req-16cf45a8-05c2-4c78-924e-ca488c7044e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:52.406523 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10b99610-4738-489d-a932-8e8cb714f4ec req-16cf45a8-05c2-4c78-924e-ca488c7044e9 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=624aa867-a71e-4343-8899-4e49257cd000&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2540147
May 27 09:30:52.452109 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1e6aae2d-a1f7-4ba8-8efa-ccb57a2a0b4f req-d681882d-c27e-429e-bca6-7439611f0c96 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1777759
May 27 09:30:52.576451 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-453e6442-c812-400f-9b2b-697041ad63ae req-4df8771e-f8d2-42a6-96b7-7c53bcf9c121 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:52.578195 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-453e6442-c812-400f-9b2b-697041ad63ae req-4df8771e-f8d2-42a6-96b7-7c53bcf9c121 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 944 time: 0.2769747
May 27 09:30:52.614419 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10b99610-4738-489d-a932-8e8cb714f4ec req-6c2ffb8d-b07f-4a13-9ea5-454624677723 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1896925
May 27 09:30:52.661954 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d13060-d889-4d4e-b2cc-5eba53db73bc req-54856a56-6c86-4103-8535-350aba488512 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:52.663609 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f9d13060-d889-4d4e-b2cc-5eba53db73bc req-54856a56-6c86-4103-8535-350aba488512 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=ea51e621877d47f29b60bce5258df734&device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 1097 time: 0.1868970
May 27 09:30:52.875128 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d13060-d889-4d4e-b2cc-5eba53db73bc req-ad836a43-fe8f-4464-b922-ab460a3289f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:52.877843 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f9d13060-d889-4d4e-b2cc-5eba53db73bc req-ad836a43-fe8f-4464-b922-ab460a3289f4 service neutron] 10.222.0.11 "GET /v2.0/networks?id=7a08fef5-d013-4fc8-8260-e3fd96453634 HTTP/1.1" status: 200  len: 915 time: 0.2059956
May 27 09:30:52.895054 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-453e6442-c812-400f-9b2b-697041ad63ae req-a5285621-1621-45d0-a4ec-4c37a10ed56e tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3061244
May 27 09:30:53.027518 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff6f1357-6fd5-4da1-b728-927e15cac9bb req-170c39ae-f402-4a66-a9ef-36af556f0dc5 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:53.032970 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ff6f1357-6fd5-4da1-b728-927e15cac9bb req-170c39ae-f402-4a66-a9ef-36af556f0dc5 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.3721654
May 27 09:30:53.033353 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f9d13060-d889-4d4e-b2cc-5eba53db73bc req-885bbfad-0d50-4a97-9f34-7ad510b6144c service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4c74ea48-9f46-439c-96c3-0cfd268e3274 HTTP/1.1" status: 200  len: 217 time: 0.1462746
May 27 09:30:53.037205 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10b99610-4738-489d-a932-8e8cb714f4ec req-f891fdf6-8d43-4485-9389-9b98e23633ea service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4085639
May 27 09:30:53.126155 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ff6f1357-6fd5-4da1-b728-927e15cac9bb req-5d2d5d71-04d4-426b-9c0f-c47314313eed tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0873275
May 27 09:30:53.178750 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d13060-d889-4d4e-b2cc-5eba53db73bc req-70182436-cca5-411b-91f6-1fabb19fa3cd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:53.188430 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f9d13060-d889-4d4e-b2cc-5eba53db73bc req-70182436-cca5-411b-91f6-1fabb19fa3cd service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b5e42a76-0f30-4445-a1f6-5d4cc78bf42c HTTP/1.1" status: 200  len: 854 time: 0.1424198
May 27 09:30:53.286775 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f9d13060-d889-4d4e-b2cc-5eba53db73bc req-363882ad-7563-4458-9d6c-a8770d1f49de service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7a08fef5-d013-4fc8-8260-e3fd96453634&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0909061
May 27 09:30:53.527499 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f9d13060-d889-4d4e-b2cc-5eba53db73bc req-3cc90d22-9817-457d-a584-78b07b04a7b6 service neutron] 10.222.0.11 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2323215
May 27 09:30:53.811773 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3d322df-49d7-4cc3-8543-a04be580296d req-a4650437-4d9d-414c-a5fa-d89a84b64168 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:53.813377 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a3d322df-49d7-4cc3-8543-a04be580296d req-a4650437-4d9d-414c-a5fa-d89a84b64168 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 945 time: 0.3972774
May 27 09:30:53.853369 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-f9d13060-d889-4d4e-b2cc-5eba53db73bc req-29a9aaf6-bd66-4387-a118-c21bf564ae52 service neutron] 10.222.0.11 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3150868
May 27 09:30:53.916956 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e00bc157-67a7-4868-b5a8-369390e4813c req-5573993a-ced9-4448-b3ba-74d6ebf4d150 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:53.918546 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e00bc157-67a7-4868-b5a8-369390e4813c req-5573993a-ced9-4448-b3ba-74d6ebf4d150 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.4015141
May 27 09:30:53.973403 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ace459e-f49a-4633-8e0c-6f9601d06fa0 req-c5272aa8-4b49-41b9-b9c7-ed068db7a8bd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:53.975108 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ace459e-f49a-4633-8e0c-6f9601d06fa0 req-c5272aa8-4b49-41b9-b9c7-ed068db7a8bd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.4434872
May 27 09:30:54.096835 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e00bc157-67a7-4868-b5a8-369390e4813c req-2fdf2a28-58ef-456c-aedb-37ce1c87407f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1401622
May 27 09:30:54.114575 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ace459e-f49a-4633-8e0c-6f9601d06fa0 req-4708a15a-0b74-4675-bd8d-7a44c6416325 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1240263
May 27 09:30:54.136227 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-a3d322df-49d7-4cc3-8543-a04be580296d req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Deleting port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:30:54.136797 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a3d322df-49d7-4cc3-8543-a04be580296d req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:54.170669 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52038) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:54.426351 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-a3d322df-49d7-4cc3-8543-a04be580296d req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] For port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=8cbe31e4-ac6c-42df-8d4e-a93e185158ac,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:54.427123 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a3d322df-49d7-4cc3-8543-a04be580296d req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:54.591350 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-a3d322df-49d7-4cc3-8543-a04be580296d req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Calling delete_port for 8cbe31e4-ac6c-42df-8d4e-a93e185158ac owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:30:54.883761 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ed09a10-09fb-43fb-9d82-506962f17c79 tempest-TestShelveInstance-1304068066 tempest-TestShelveInstance-1304068066-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:54.884811 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1ed09a10-09fb-43fb-9d82-506962f17c79 tempest-TestShelveInstance-1304068066 tempest-TestShelveInstance-1304068066-project-admin] Synchronizing usage tracker for tenant:8fa04a9552394b50b0cef7e35b83a87c on resource:port {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:30:54.945789 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1ed09a10-09fb-43fb-9d82-506962f17c79 tempest-TestShelveInstance-1304068066 tempest-TestShelveInstance-1304068066-project-admin] Unset dirty status for tenant:8fa04a9552394b50b0cef7e35b83a87c on resource:port {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:30:54.948203 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-1ed09a10-09fb-43fb-9d82-506962f17c79 tempest-TestShelveInstance-1304068066 tempest-TestShelveInstance-1304068066-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 1093 time: 0.7758589
May 27 09:30:54.953211 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52052) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:54.966270 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Request body: {'floatingip': {'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'port_id': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'fixed_ip_address': '172.20.0.9'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:30:54.977635 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:54.987869 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Usage tracker for resource:floatingip and tenant:a31154df1ce4420f9bdf53b8b3b3649e is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:54.994361 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:55.002359 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-557c9567-acf2-45b7-81c9-cf2e0ed945d5 req-8cf946ac-a475-43f4-b68b-509bb0db3cba tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:55.009848 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-557c9567-acf2-45b7-81c9-cf2e0ed945d5 req-8cf946ac-a475-43f4-b68b-509bb0db3cba tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 944 time: 0.2355614
May 27 09:30:55.028548 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:55.063231 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for floatingip, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:55.075719 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409133bf-d94b-4c89-86ae-500eabb5430b req-616a06ef-5c56-4e8d-9df1-0c6d0adf9637 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:55.075719 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-409133bf-d94b-4c89-86ae-500eabb5430b req-616a06ef-5c56-4e8d-9df1-0c6d0adf9637 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 945 time: 0.2982011
May 27 09:30:55.098577 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 4c74ea48-9f46-439c-96c3-0cfd268e3274 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:30:55.174143 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-557c9567-acf2-45b7-81c9-cf2e0ed945d5 req-a2dc9f00-b6ef-49e2-9bbf-10dee68ece64 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1627018
May 27 09:30:55.239149 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-409133bf-d94b-4c89-86ae-500eabb5430b req-556c2b02-6274-4c83-abac-769ff287c9f8 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1668561
May 27 09:30:55.246794 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a3d322df-49d7-4cc3-8543-a04be580296d req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:55.274885 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ef74e34d-be7f-4443-92db-71ee72cc455a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:55.371091 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Pushing event deleted for resources: {'Port': ['ID=8cbe31e4-ac6c-42df-8d4e-a93e185158ac,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:55.402939 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['2890994f-299e-4a4d-8e0a-945b6c38ecfe', '51dd2656-44f3-41cb-b4e3-38beccc875b4', '494fef8d-4a46-4dc4-8bdc-d2550769b2dd', '8cbe31e4-ac6c-42df-8d4e-a93e185158ac'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:30:55.408686 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:55.510008 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.235s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:55.603847 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-a3d322df-49d7-4cc3-8543-a04be580296d req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] No DVR routers for this DVR port 8cbe31e4-ac6c-42df-8d4e-a93e185158ac on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:30:55.612123 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a3d322df-49d7-4cc3-8543-a04be580296d req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:55.615471 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6284c06f-2253-4d19-b502-1332d55684cc', 'name': 'network-vif-deleted', 'tag': '8cbe31e4-ac6c-42df-8d4e-a93e185158ac'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:30:55.693136 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 4c74ea48-9f46-439c-96c3-0cfd268e3274, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=4c74ea48-9f46-439c-96c3-0cfd268e3274,segment=NetworkSegment(111bd85e-76cc-4ba7-8f48-b8ddd0684287),segment_id=111bd85e-76cc-4ba7-8f48-b8ddd0684287)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:55.725481 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a3d322df-49d7-4cc3-8543-a04be580296d req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "DELETE /v2.0/ports/8cbe31e4-ac6c-42df-8d4e-a93e185158ac HTTP/1.1" status: 204  len: 173 time: 1.9030530
May 27 09:30:55.764535 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-177fd6a5-f67a-425f-a154-e6a59b2225f8 req-fbc2ec0e-3096-4c30-9623-a53a62807c17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:55.769476 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-177fd6a5-f67a-425f-a154-e6a59b2225f8 req-fbc2ec0e-3096-4c30-9623-a53a62807c17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.2534237
May 27 09:30:55.848931 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '4c74ea48-9f46-439c-96c3-0cfd268e3274', 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634', 'port_id': '4c74ea48-9f46-439c-96c3-0cfd268e3274', 'mac_address': 'fa:16:3e:e0:69:9f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b5e42a76-0f30-4445-a1f6-5d4cc78bf42c', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:30:55.881322 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6284c06f-2253-4d19-b502-1332d55684cc', 'name': 'network-vif-deleted', 'tag': '8cbe31e4-ac6c-42df-8d4e-a93e185158ac', 'status': 'completed', 'code': 200}
May 27 09:30:55.898598 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Allocated IP 172.27.1.54 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/95111807-faa4-4f90-b428-5e65ff824272) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:30:55.937146 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-177fd6a5-f67a-425f-a154-e6a59b2225f8 req-9dd80713-32b7-4bd2-ab62-c67bcadeaa6a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1601913
May 27 09:30:56.092024 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:56.204073 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4c74ea48-9f46-439c-96c3-0cfd268e3274 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:30:56.215225 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e24712f4-8e50-4f6e-9cf4-040a04180553 req-6fa568af-c293-4df8-803b-2178478b818b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:56.231865 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e24712f4-8e50-4f6e-9cf4-040a04180553 req-6fa568af-c293-4df8-803b-2178478b818b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2057946
May 27 09:30:56.292764 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 4c74ea48-9f46-439c-96c3-0cfd268e3274, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=4c74ea48-9f46-439c-96c3-0cfd268e3274,segment=NetworkSegment(111bd85e-76cc-4ba7-8f48-b8ddd0684287),segment_id=111bd85e-76cc-4ba7-8f48-b8ddd0684287)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:56.302066 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:56.304744 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:56.345857 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:56.381927 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:56.388128 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-530f1c3d-15a5-4b67-be76-31990c69ccfa service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:56.542013 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event updated for resources: {'Port': ['ID=95111807-faa4-4f90-b428-5e65ff824272,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:56.555809 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:56.568871 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e24712f4-8e50-4f6e-9cf4-040a04180553 req-639406a6-4b22-432c-a596-8e8c025f2e01 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3345540
May 27 09:30:56.576066 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:30:56.582133 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:30:56.587836 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:30:56.701533 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc442c3b-2219-4022-a367-47d45b3e5127 req-7e1a60af-f943-4b86-8847-416dd3635215 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:56.703355 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:56.707770 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dc442c3b-2219-4022-a367-47d45b3e5127 req-7e1a60af-f943-4b86-8847-416dd3635215 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 945 time: 0.3176351
May 27 09:30:56.726919 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=4c74ea48-9f46-439c-96c3-0cfd268e3274,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:56.745944 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.398s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:56.787172 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['4c74ea48-9f46-439c-96c3-0cfd268e3274'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:30:56.820357 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-776117c8-dfa1-42a8-bf74-745f35a4be74 req-e6329390-8c31-4c75-b895-c2b5d0e1d12b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Synchronizing usage tracker for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:30:56.830648 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dc442c3b-2219-4022-a367-47d45b3e5127 req-f69e89ea-6ed3-48cc-9279-cad2968a45e7 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1156740
May 27 09:30:56.858410 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-776117c8-dfa1-42a8-bf74-745f35a4be74 req-e6329390-8c31-4c75-b895-c2b5d0e1d12b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Unset dirty status for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:30:56.870974 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-776117c8-dfa1-42a8-bf74-745f35a4be74 req-e6329390-8c31-4c75-b895-c2b5d0e1d12b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.1146593
May 27 09:30:57.133048 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 8cbe31e4-ac6c-42df-8d4e-a93e185158ac no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:30:57.197887 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 8cbe31e4-ac6c-42df-8d4e-a93e185158ac {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:30:57.198240 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 8cbe31e4-ac6c-42df-8d4e-a93e185158ac not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:30:57.306158 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9372ae7-e669-4815-8868-749329ff3762 req-f51f4677-0212-4472-8634-b74e15808941 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:57.308821 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a9372ae7-e669-4815-8868-749329ff3762 req-f51f4677-0212-4472-8634-b74e15808941 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.1700933
May 27 09:30:57.380141 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a9372ae7-e669-4815-8868-749329ff3762 req-16dfa5f6-4560-44a4-bb0f-7b8b4d02a423 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0632730
May 27 09:30:57.613115 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:57.739252 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:57.825592 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15bd26c6-f93a-4a02-84a2-beaca350c2ea req-f33a996c-d81c-4142-bad7-84f2ff0b88a9 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:57.827138 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-15bd26c6-f93a-4a02-84a2-beaca350c2ea req-f33a996c-d81c-4142-bad7-84f2ff0b88a9 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.0984275
May 27 09:30:57.902693 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-15bd26c6-f93a-4a02-84a2-beaca350c2ea req-32c4c0d5-928b-48e7-b324-da448ed3b095 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0683446
May 27 09:30:58.053404 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:58.069895 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:58.076421 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:58.159576 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f16463de-dc66-4d81-8828-fc5d198dbe1d req-d3a1b121-74af-49ed-863c-ac8e472d7d97 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.0566170
May 27 09:30:58.200686 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75710eea-968f-453f-99c4-d2eb2b1b4837 req-f8d711e5-261c-449a-9a91-3c2844d1f020 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:58.205138 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-75710eea-968f-453f-99c4-d2eb2b1b4837 req-f8d711e5-261c-449a-9a91-3c2844d1f020 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 945 time: 0.1834083
May 27 09:30:58.302477 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event updated for resources: {'Port': ['ID=95111807-faa4-4f90-b428-5e65ff824272,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:58.305698 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:58.314680 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:58.349067 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-75710eea-968f-453f-99c4-d2eb2b1b4837 req-61958236-1937-4cfd-906c-3248d158b837 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1342359
May 27 09:30:58.677227 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed157eb-9ccf-4a75-82c9-df429936a37e req-a02af2ca-5af2-4a6b-bb68-de9a9a62ce22 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:58.685617 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4ed157eb-9ccf-4a75-82c9-df429936a37e req-a02af2ca-5af2-4a6b-bb68-de9a9a62ce22 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.1307054
May 27 09:30:58.732213 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.l3_db [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Floating IP 3e2b6984-3c92-4d2b-80e1-90ed0b815aa3 associated. External IP: 172.27.1.54, port: 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d.
May 27 09:30:58.751942 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4ed157eb-9ccf-4a75-82c9-df429936a37e req-f71f284e-12a7-4622-86b2-568c28f06a90 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0638182
May 27 09:30:58.935794 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52114) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:59.116777 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 4c74ea48-9f46-439c-96c3-0cfd268e3274 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:30:59.164855 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-fac1ec77-3994-4355-827b-9dfc200734ec admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:59.190678 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-fac1ec77-3994-4355-827b-9dfc200734ec admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:30:59.194869 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-fac1ec77-3994-4355-827b-9dfc200734ec admin admin] Usage tracker for resource:security_group_rule and tenant:494737a3bede46f1b763af6c52c266e7 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:30:59.216747 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-fac1ec77-3994-4355-827b-9dfc200734ec admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:30:59.219405 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 4c74ea48-9f46-439c-96c3-0cfd268e3274 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:30:59.241449 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 4c74ea48-9f46-439c-96c3-0cfd268e3274 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:30:59.244231 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:59.249004 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-fac1ec77-3994-4355-827b-9dfc200734ec admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:30:59.308730 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Router 9a650133-6433-44b6-9741-b3bd050216ae has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:30:59.336717 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2de09acc-bfbf-45fc-ab00-2f7d54095929 req-37cac3dd-c154-493a-b305-1ecdcc29d87e tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:30:59.339183 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2de09acc-bfbf-45fc-ab00-2f7d54095929 req-37cac3dd-c154-493a-b305-1ecdcc29d87e tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2498565
May 27 09:30:59.521287 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:59.530823 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7f125988-70e0-4f12-9105-07eb21c9928f req-b81c43b4-2b9c-4052-89b5-023cc614bc0a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.1297593
May 27 09:30:59.564678 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2de09acc-bfbf-45fc-ab00-2f7d54095929 req-450d1903-3cce-4484-8bc6-52b94f321d19 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2151537
May 27 09:30:59.607643 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c33bed6-7082-470c-b880-7efb7cf09e91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c74ea48-9f46-439c-96c3-0cfd268e3274'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:30:59.636886 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 4c74ea48-9f46-439c-96c3-0cfd268e3274, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=4c74ea48-9f46-439c-96c3-0cfd268e3274,segment=NetworkSegment(111bd85e-76cc-4ba7-8f48-b8ddd0684287),segment_id=111bd85e-76cc-4ba7-8f48-b8ddd0684287)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:30:59.645287 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:59.647696 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:59.703785 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-fac1ec77-3994-4355-827b-9dfc200734ec admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:59.723191 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-fac1ec77-3994-4355-827b-9dfc200734ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:30:59.727705 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c33bed6-7082-470c-b880-7efb7cf09e91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c74ea48-9f46-439c-96c3-0cfd268e3274', 'code': 200}
May 27 09:30:59.738559 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-9e9500c3-d5e7-4969-afc8-32b76f4c8935 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:30:59.811617 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=4c74ea48-9f46-439c-96c3-0cfd268e3274,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:30:59.816485 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:30:59.838933 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:30:59.851498 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-fac1ec77-3994-4355-827b-9dfc200734ec admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=494737a3bede46f1b763af6c52c266e7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.9141591
May 27 09:30:59.853667 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c69998bb-d74d-457d-806e-24930bf106df None None] Sync routers for ids ['9a650133-6433-44b6-9741-b3bd050216ae'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:30:59.856223 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52130) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:30:59.874058 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c69998bb-d74d-457d-806e-24930bf106df None None] Routers {'9a650133-6433-44b6-9741-b3bd050216ae'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:30:59.875182 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-c69998bb-d74d-457d-806e-24930bf106df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed9dc7f0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:30:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['9a650133-6433-44b6-9741-b3bd050216ae'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:30:59.901579 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:00.009505 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 995 time: 5.0545745
May 27 09:31:00.010712 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:31:00.015909 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fac1ec77-3994-4355-827b-9dfc200734ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e80288fd-3c6e-4091-831b-36bf8e354b70,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:00.094063 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-fac1ec77-3994-4355-827b-9dfc200734ec admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.355s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:00.172416 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3bed3d94-647e-4b1d-b728-97d65a292b71 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:00.223171 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-c69998bb-d74d-457d-806e-24930bf106df None None] Set router 9a650133-6433-44b6-9741-b3bd050216ae gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:31:00.273396 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b47729e5-04f3-458a-a1bd-d0d93c6e7b47 req-609c0334-4adf-476a-992d-f276fcab8a9f tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:00.276001 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b47729e5-04f3-458a-a1bd-d0d93c6e7b47 req-609c0334-4adf-476a-992d-f276fcab8a9f tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.4211888
May 27 09:31:00.279310 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3bed3d94-647e-4b1d-b728-97d65a292b71 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:00.464684 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546ff9d3-3305-496c-9e1f-9056456641ac req-58875754-0277-4988-868f-22d04ebb7963 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:00.467590 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-546ff9d3-3305-496c-9e1f-9056456641ac req-58875754-0277-4988-868f-22d04ebb7963 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.4367146
May 27 09:31:00.598026 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b47729e5-04f3-458a-a1bd-d0d93c6e7b47 req-507f91e1-4768-44e8-8a80-c178a4058994 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3024042
May 27 09:31:00.679746 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-546ff9d3-3305-496c-9e1f-9056456641ac req-ed5131f5-752c-4a60-bed4-66b0a10bf1e8 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1498864
May 27 09:31:00.681134 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3bed3d94-647e-4b1d-b728-97d65a292b71 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:00.715012 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-b21d2a14-bf07-4355-b668-5135d7c109e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:00.741420 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3bed3d94-647e-4b1d-b728-97d65a292b71 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:00.745610 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-3bed3d94-647e-4b1d-b728-97d65a292b71 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e80288fd-3c6e-4091-831b-36bf8e354b70 HTTP/1.1" status: 204  len: 168 time: 0.8832598
May 27 09:31:00.747950 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bed3d94-647e-4b1d-b728-97d65a292b71 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e80288fd-3c6e-4091-831b-36bf8e354b70,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:00.780211 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-3bed3d94-647e-4b1d-b728-97d65a292b71 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:00.814921 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'status': 'completed', 'code': 200}
May 27 09:31:00.943576 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-c69998bb-d74d-457d-806e-24930bf106df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed9dc7f0>, [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:08Z', 'revision_number': 4, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '3e2b6984-3c92-4d2b-80e1-90ed0b815aa3', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'floating_ip_address': '172.27.1.54', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'port_id': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 385, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'mac_address': 'fa:16:3e:80:f5:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:30:57Z', 'updated_at': '2021-05-27T09:30:57Z', 'revision_number': 0, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c03df627-c904-49cf-8192-55ef32975e9a', 'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'mac_address': 'fa:16:3e:ca:67:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:07Z', 'updated_at': '2021-05-27T09:29:17Z', 'revision_number': 5, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'subnets': [{'id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:00.949869 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c69998bb-d74d-457d-806e-24930bf106df None None] Checking router: 9a650133-6433-44b6-9741-b3bd050216ae for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:31:00.962203 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c69998bb-d74d-457d-806e-24930bf106df None None] Routers {'9a650133-6433-44b6-9741-b3bd050216ae'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:31:00.974365 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-c69998bb-d74d-457d-806e-24930bf106df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed9dc7f0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:30:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['9a650133-6433-44b6-9741-b3bd050216ae'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:01.136005 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-33cf0b7d-120c-4708-b4ef-05de873e4a53 req-fe1b9a58-6454-4b97-8d0c-33e93dc6bb8f tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.1212776
May 27 09:31:01.201337 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-c69998bb-d74d-457d-806e-24930bf106df None None] Set router 9a650133-6433-44b6-9741-b3bd050216ae gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:31:01.526127 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52156) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:01.574470 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-9e3492d8-a169-4ed2-bff3-ac6f935b5801 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:01.600446 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-9e3492d8-a169-4ed2-bff3-ac6f935b5801 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:31:01.606161 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-9e3492d8-a169-4ed2-bff3-ac6f935b5801 admin admin] Usage tracker for resource:security_group_rule and tenant:c3f9afcd850645b295210f3f31646838 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:31:01.610069 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-9e3492d8-a169-4ed2-bff3-ac6f935b5801 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:31:01.619503 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-9e3492d8-a169-4ed2-bff3-ac6f935b5801 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:31:01.633811 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8af3e9c-6aba-4f36-8657-933e25871ebd req-5dfc0ffa-6928-43ac-a42a-a07686eb12e4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:01.642715 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c8af3e9c-6aba-4f36-8657-933e25871ebd req-5dfc0ffa-6928-43ac-a42a-a07686eb12e4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2893765
May 27 09:31:01.758629 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c8af3e9c-6aba-4f36-8657-933e25871ebd req-3611a9ae-3a5f-40b3-9e53-1fbcff10af5f tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1117671
May 27 09:31:01.804907 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-9e3492d8-a169-4ed2-bff3-ac6f935b5801 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:01.811668 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-9e3492d8-a169-4ed2-bff3-ac6f935b5801 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:01.841861 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-c69998bb-d74d-457d-806e-24930bf106df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed9dc7f0>, [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:08Z', 'revision_number': 4, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '3e2b6984-3c92-4d2b-80e1-90ed0b815aa3', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'floating_ip_address': '172.27.1.54', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'port_id': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 385, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'mac_address': 'fa:16:3e:80:f5:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:30:57Z', 'updated_at': '2021-05-27T09:30:57Z', 'revision_number': 0, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c03df627-c904-49cf-8192-55ef32975e9a', 'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'mac_address': 'fa:16:3e:ca:67:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:07Z', 'updated_at': '2021-05-27T09:29:17Z', 'revision_number': 5, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'subnets': [{'id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:01.844260 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:01.854108 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c69998bb-d74d-457d-806e-24930bf106df None None] The sync data for ids ['9a650133-6433-44b6-9741-b3bd050216ae'] in dv-cinder-772623-6-iscsi is: [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:08Z', 'revision_number': 4, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '3e2b6984-3c92-4d2b-80e1-90ed0b815aa3', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'floating_ip_address': '172.27.1.54', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'port_id': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 385, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'mac_address': 'fa:16:3e:80:f5:fa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:30:57Z', 'updated_at': '2021-05-27T09:30:57Z', 'revision_number': 0, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c03df627-c904-49cf-8192-55ef32975e9a', 'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'mac_address': 'fa:16:3e:ca:67:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:07Z', 'updated_at': '2021-05-27T09:29:17Z', 'revision_number': 5, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'subnets': [{'id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:31:01.906610 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e3492d8-a169-4ed2-bff3-ac6f935b5801 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6eac1be-cd00-4ef7-9484-11e860629b8f,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:01.910951 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-9e3492d8-a169-4ed2-bff3-ac6f935b5801 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:01.913674 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-9e3492d8-a169-4ed2-bff3-ac6f935b5801 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c3f9afcd850645b295210f3f31646838&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3858306
May 27 09:31:01.917182 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52166) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:02.043665 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-144ab70a-9d20-4180-88e8-9f932a5979c6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:02.084697 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-144ab70a-9d20-4180-88e8-9f932a5979c6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:02.092902 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b52dec41-8db0-4e46-8f67-52a5cea1898e req-80ad8e65-817c-49af-a4a4-94f517583585 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:02.094743 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b52dec41-8db0-4e46-8f67-52a5cea1898e req-80ad8e65-817c-49af-a4a4-94f517583585 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.2364185
May 27 09:31:02.119199 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dc5d434-71b6-47ec-ab91-791a69dfcd52 req-6d87bf0c-c679-4a41-b03b-0247a57fc0c6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:02.126972 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2dc5d434-71b6-47ec-ab91-791a69dfcd52 req-6d87bf0c-c679-4a41-b03b-0247a57fc0c6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.1676552
May 27 09:31:02.217708 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-144ab70a-9d20-4180-88e8-9f932a5979c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:02.228525 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-bc55d8a8-d6cc-41f0-829c-2fa39d36863b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:02.236194 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2dc5d434-71b6-47ec-ab91-791a69dfcd52 req-bad6f289-471d-47e4-9c53-5d1d1f707c5f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1077845
May 27 09:31:02.240248 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b52dec41-8db0-4e46-8f67-52a5cea1898e req-83bd92ba-5ce4-4f7f-b436-a07243c5afb9 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1110957
May 27 09:31:02.256093 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-144ab70a-9d20-4180-88e8-9f932a5979c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6eac1be-cd00-4ef7-9484-11e860629b8f,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:02.260935 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-144ab70a-9d20-4180-88e8-9f932a5979c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:02.269572 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-144ab70a-9d20-4180-88e8-9f932a5979c6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:02.271093 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-144ab70a-9d20-4180-88e8-9f932a5979c6 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/e6eac1be-cd00-4ef7-9484-11e860629b8f HTTP/1.1" status: 204  len: 168 time: 0.3529840
May 27 09:31:02.333105 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-95474cc5-c7a1-44b6-beb9-a323718a0bc0 None None] New status for floating IP 3e2b6984-3c92-4d2b-80e1-90ed0b815aa3: ACTIVE {{(pid=91822) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:31:02.474076 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e9d532a9-7e65-4409-80b7-4e861a963cb4 req-f18b63e9-406d-476d-8ee6-3209e9a4306d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.0594006
May 27 09:31:03.007426 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52180) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:03.031222 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2fe0a1-7451-495b-b910-2d75d0f6958b req-686d9fee-b28e-49d9-8dff-5c73da3c0410 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:03.039497 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fd2fe0a1-7451-495b-b910-2d75d0f6958b req-686d9fee-b28e-49d9-8dff-5c73da3c0410 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1163931
May 27 09:31:03.039813 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6bd38f53-7cef-4494-9df6-787596bee0af admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:03.070490 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-6bd38f53-7cef-4494-9df6-787596bee0af admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:31:03.077959 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-6bd38f53-7cef-4494-9df6-787596bee0af admin admin] Usage tracker for resource:security_group_rule and tenant:fb7786ed99c64686b4b402d45ab74af5 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:31:03.083951 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-6bd38f53-7cef-4494-9df6-787596bee0af admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:31:03.096883 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-6bd38f53-7cef-4494-9df6-787596bee0af admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:31:03.100780 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fd2fe0a1-7451-495b-b910-2d75d0f6958b req-67e25882-d6ae-4c83-9142-66a4b869c716 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0597620
May 27 09:31:03.236107 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6bd38f53-7cef-4494-9df6-787596bee0af admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:03.241348 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6bd38f53-7cef-4494-9df6-787596bee0af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:03.249831 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b1706588-ec70-4b3a-881d-2e72944001d5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:03.299331 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bd38f53-7cef-4494-9df6-787596bee0af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=78dbfca3-462e-425a-804a-64d9afb4a877,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:03.302721 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6bd38f53-7cef-4494-9df6-787596bee0af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:03.305755 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-6bd38f53-7cef-4494-9df6-787596bee0af admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=fb7786ed99c64686b4b402d45ab74af5&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2957060
May 27 09:31:03.310170 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52188) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:03.502706 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b24b80d8-16d1-422e-a0be-b5f03fbc1682 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:03.586964 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b24b80d8-16d1-422e-a0be-b5f03fbc1682 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:03.632526 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc11cdf-f609-45e5-b4d6-f5d2e8913d9f req-ced40847-ce5a-4501-a9ff-ea0ffd0c195f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:03.634101 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4bc11cdf-f609-45e5-b4d6-f5d2e8913d9f req-ced40847-ce5a-4501-a9ff-ea0ffd0c195f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.2284517
May 27 09:31:03.716331 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4bc11cdf-f609-45e5-b4d6-f5d2e8913d9f req-99e95102-1fba-49bf-9dbc-a2e8ff41b8c2 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0676155
May 27 09:31:03.732458 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684875f9-0a82-4baf-b3bb-7bd2d4f547b3 req-cff412e1-11c8-4ab3-89ae-04a5cca68be6 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:03.734051 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-684875f9-0a82-4baf-b3bb-7bd2d4f547b3 req-cff412e1-11c8-4ab3-89ae-04a5cca68be6 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.2038574
May 27 09:31:03.735266 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b24b80d8-16d1-422e-a0be-b5f03fbc1682 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:03.739654 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7fb0a986-e710-4fe7-bd8e-811debba7927 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:03.781788 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b24b80d8-16d1-422e-a0be-b5f03fbc1682 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=78dbfca3-462e-425a-804a-64d9afb4a877,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:03.807460 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-b24b80d8-16d1-422e-a0be-b5f03fbc1682 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:03.819025 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b24b80d8-16d1-422e-a0be-b5f03fbc1682 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:03.825601 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-b24b80d8-16d1-422e-a0be-b5f03fbc1682 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/78dbfca3-462e-425a-804a-64d9afb4a877 HTTP/1.1" status: 204  len: 168 time: 0.5134187
May 27 09:31:03.892327 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-684875f9-0a82-4baf-b3bb-7bd2d4f547b3 req-7593d0d7-1898-4def-8971-4cff4f5944ec tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1435263
May 27 09:31:03.978003 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8fffe82f-39e6-406f-97df-908d2a1c3ffd req-33f652f2-a3e3-4e9c-95da-5950105fc786 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.0775251
May 27 09:31:04.351808 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0f3c438-4d41-4194-9264-498eaedf4fd5 req-6a75450f-57a4-4500-bb33-ecd55873c49d tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:04.353502 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d0f3c438-4d41-4194-9264-498eaedf4fd5 req-6a75450f-57a4-4500-bb33-ecd55873c49d tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1143844
May 27 09:31:04.427727 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d0f3c438-4d41-4194-9264-498eaedf4fd5 req-32a713d0-e8d3-46d3-90e4-f6c3a14473a2 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0570662
May 27 09:31:05.099073 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ec448e-761a-4374-9336-37da15c70e9a req-90d7ede0-1004-4e7f-9df8-a53df29aafee tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:05.124820 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a6ec448e-761a-4374-9336-37da15c70e9a req-90d7ede0-1004-4e7f-9df8-a53df29aafee tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.2105596
May 27 09:31:05.245941 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a6ec448e-761a-4374-9336-37da15c70e9a req-cb031a3a-6d5f-496e-8696-a90381736fa9 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1198690
May 27 09:31:05.279978 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54376d64-9d7e-4c33-aaf7-0bb2c04beb74 req-992155ee-f60d-4cfa-9c4e-0b660acded83 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:05.281561 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-54376d64-9d7e-4c33-aaf7-0bb2c04beb74 req-992155ee-f60d-4cfa-9c4e-0b660acded83 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.1246915
May 27 09:31:05.383402 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-54376d64-9d7e-4c33-aaf7-0bb2c04beb74 req-368ddec7-2ca5-4ba4-900e-8d43de7b58db tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0945823
May 27 09:31:05.535334 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-34e3ef7a-a6c3-4455-bea8-d8e22ead1bc5 req-6a429cae-430b-4036-a682-3ebdd802e53b tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.1182554
May 27 09:31:05.775040 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc70e8f7-0171-46d9-be8c-d6b44b7432df req-9fb9cece-e0d4-4d15-a79c-90f3bc8d83c5 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:05.776731 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bc70e8f7-0171-46d9-be8c-d6b44b7432df req-9fb9cece-e0d4-4d15-a79c-90f3bc8d83c5 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1917193
May 27 09:31:05.848343 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bc70e8f7-0171-46d9-be8c-d6b44b7432df req-95225366-92b7-4f7f-beba-58161e8f998a tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0640032
May 27 09:31:06.681122 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-693ef072-bd92-48aa-b8f9-58a94b01dbac req-ee219ab7-8ed0-497b-817e-719d93865fbe tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:06.683879 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-693ef072-bd92-48aa-b8f9-58a94b01dbac req-ee219ab7-8ed0-497b-817e-719d93865fbe tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.2698987
May 27 09:31:06.773400 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6506a819-56b3-41a4-9ff0-0c4c4acfa38b req-ab999244-6f7a-4e88-bfc3-e1c26b501293 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:06.776142 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6506a819-56b3-41a4-9ff0-0c4c4acfa38b req-ab999244-6f7a-4e88-bfc3-e1c26b501293 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.2468028
May 27 09:31:06.821162 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-693ef072-bd92-48aa-b8f9-58a94b01dbac req-3c123f4a-631d-4ed4-a82d-32d1a423406e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1287088
May 27 09:31:06.879174 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6506a819-56b3-41a4-9ff0-0c4c4acfa38b req-ea0e3dc6-3d14-450f-8ab5-e9fb5fc34756 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0900190
May 27 09:31:06.999187 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-088c9a00-59c7-4a84-92da-feed8980801c req-99335ff7-688c-46ea-8832-68c85f80bf53 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=6284c06f-2253-4d19-b502-1332d55684cc HTTP/1.1" status: 200  len: 210 time: 0.0463526
May 27 09:31:07.273982 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f076263-e8b2-4997-af45-0ce1ed6b2de6 req-2855d2e1-585b-4d76-8227-78d91dda3236 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:07.275534 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9f076263-e8b2-4997-af45-0ce1ed6b2de6 req-2855d2e1-585b-4d76-8227-78d91dda3236 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2123086
May 27 09:31:07.335337 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9f076263-e8b2-4997-af45-0ce1ed6b2de6 req-76ef805e-9dad-46af-ae2a-eac06e3b9d8a tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0532453
May 27 09:31:07.669350 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623ef943-7522-4af2-84ed-0318c6ed7a69 req-3f87bb48-0704-4f9e-9969-d2d01717506e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:07.675851 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-623ef943-7522-4af2-84ed-0318c6ed7a69 req-3f87bb48-0704-4f9e-9969-d2d01717506e service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a31154df1ce4420f9bdf53b8b3b3649e&device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 1098 time: 0.0990877
May 27 09:31:07.830186 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3082d893-4d8e-423a-b203-68cde89c6331 req-54fd930f-0815-44a7-bf9f-6c8f374bf459 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:07.831786 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3082d893-4d8e-423a-b203-68cde89c6331 req-54fd930f-0815-44a7-bf9f-6c8f374bf459 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 1099 time: 0.0969124
May 27 09:31:07.883867 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3082d893-4d8e-423a-b203-68cde89c6331 req-4e9c6085-abde-4041-b965-ea41209802ab service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0415795
May 27 09:31:07.910004 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623ef943-7522-4af2-84ed-0318c6ed7a69 req-f6ec72c5-9500-4c09-9842-87be3ca6a181 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:07.911966 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-623ef943-7522-4af2-84ed-0318c6ed7a69 req-f6ec72c5-9500-4c09-9842-87be3ca6a181 service neutron] 10.222.0.11 "GET /v2.0/networks?id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba HTTP/1.1" status: 200  len: 909 time: 0.2165635
May 27 09:31:08.197724 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-623ef943-7522-4af2-84ed-0318c6ed7a69 req-31cacc9c-fd9c-462a-a918-22c206db07e1 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d HTTP/1.1" status: 200  len: 1000 time: 0.2497351
May 27 09:31:08.305217 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3a9a52-ee17-4367-bd73-5e9b9582026e req-d853f7fb-2f68-43f2-845f-266d4bc6f3bc tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:08.307839 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4a3a9a52-ee17-4367-bd73-5e9b9582026e req-d853f7fb-2f68-43f2-845f-266d4bc6f3bc tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.2849960
May 27 09:31:08.316326 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623ef943-7522-4af2-84ed-0318c6ed7a69 req-7d651067-4390-49ef-812a-1252b4ca2311 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:08.318735 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-623ef943-7522-4af2-84ed-0318c6ed7a69 req-7d651067-4390-49ef-812a-1252b4ca2311 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6659533b-b3b0-4d3c-8bf0-709a19b7728d HTTP/1.1" status: 200  len: 847 time: 0.1062047
May 27 09:31:08.380641 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a92ad5-a9b7-4f36-93c5-4145b43fb244 req-5ea60759-6fbd-4619-bb39-97305a2eeaee tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:08.382216 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-17a92ad5-a9b7-4f36-93c5-4145b43fb244 req-5ea60759-6fbd-4619-bb39-97305a2eeaee tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.2893839
May 27 09:31:08.470764 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4a3a9a52-ee17-4367-bd73-5e9b9582026e req-9c2187d1-8c32-49d7-8beb-3aa5f7345885 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1481481
May 27 09:31:08.487599 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-17a92ad5-a9b7-4f36-93c5-4145b43fb244 req-95a390f7-3af0-4382-b305-c54d0ebcec11 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0914004
May 27 09:31:08.516748 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-569bc8f0-2a46-41d5-a014-9a13f7efec6a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:08.525759 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623ef943-7522-4af2-84ed-0318c6ed7a69 req-ee0aa2b3-4436-4ead-b2ab-1a518f388c48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:08.528498 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-623ef943-7522-4af2-84ed-0318c6ed7a69 req-ee0aa2b3-4436-4ead-b2ab-1a518f388c48 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1879508
May 27 09:31:08.818481 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-623ef943-7522-4af2-84ed-0318c6ed7a69 req-a3a50b0f-37e0-4635-9b5d-e49f1f0b96c4 service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2757976
May 27 09:31:08.913267 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7ee6106-9eb4-48a1-8424-454ba9f296e0 req-5e2ac88a-20e9-427e-896b-a93adcf99d51 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:08.914791 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f7ee6106-9eb4-48a1-8424-454ba9f296e0 req-5e2ac88a-20e9-427e-896b-a93adcf99d51 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2294750
May 27 09:31:09.001820 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f7ee6106-9eb4-48a1-8424-454ba9f296e0 req-91834a3c-36f2-42ba-b25f-4221af6f02b7 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0730898
May 27 09:31:09.011504 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-623ef943-7522-4af2-84ed-0318c6ed7a69 req-f7c66f14-5227-4d1d-9642-63e0862cdad8 service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1828845
May 27 09:31:09.848044 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d914e6f4-f0e8-4578-ab99-6d44895d481e req-11062de7-0a8f-4ee9-b02b-511e71938601 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:09.850504 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d914e6f4-f0e8-4578-ab99-6d44895d481e req-11062de7-0a8f-4ee9-b02b-511e71938601 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.2237065
May 27 09:31:09.868935 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16f666e0-240c-4689-a301-e56b5690cf62 req-948a1ee8-e4fd-4db7-8099-7b902536345f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:09.871356 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-16f666e0-240c-4689-a301-e56b5690cf62 req-948a1ee8-e4fd-4db7-8099-7b902536345f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.1765971
May 27 09:31:09.993753 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d914e6f4-f0e8-4578-ab99-6d44895d481e req-87a1c3e3-f619-414c-9157-acdc0ea52748 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1207967
May 27 09:31:10.011863 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-16f666e0-240c-4689-a301-e56b5690cf62 req-08783202-7198-4d4d-bea0-0cdf260e40eb tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1153293
May 27 09:31:10.303803 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c9b5ccd-0e15-458e-8fb9-21e34b55012c req-1e46e8ae-b12f-449a-b006-716dfd2cf551 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:10.304902 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2c9b5ccd-0e15-458e-8fb9-21e34b55012c req-1e46e8ae-b12f-449a-b006-716dfd2cf551 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1108158
May 27 09:31:10.384881 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2c9b5ccd-0e15-458e-8fb9-21e34b55012c req-7030449e-42b3-48e8-ac6b-8323a67f48c0 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0726993
May 27 09:31:10.673674 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20a7b6ab-9eac-4c28-bdcb-85212fa5e72e req-6b17cdc4-83da-4155-9ac5-74e5840a97be tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:10.675456 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-20a7b6ab-9eac-4c28-bdcb-85212fa5e72e req-6b17cdc4-83da-4155-9ac5-74e5840a97be tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1623397
May 27 09:31:10.683090 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fc2ff9e-556c-446f-be41-bb18a730fc2c req-479c9483-a824-4aa9-9d4e-f1b636b0061a tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:10.684885 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6fc2ff9e-556c-446f-be41-bb18a730fc2c req-479c9483-a824-4aa9-9d4e-f1b636b0061a tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.11 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.1318920
May 27 09:31:10.941740 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-20a7b6ab-9eac-4c28-bdcb-85212fa5e72e req-893c8045-51ad-453a-a98e-832b8d12feac tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2556050
May 27 09:31:11.026381 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36b91165-030b-442c-a69b-afb078270e39 req-35ae4be5-8586-4879-83a7-94e2cee383ea tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:11.027854 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-36b91165-030b-442c-a69b-afb078270e39 req-35ae4be5-8586-4879-83a7-94e2cee383ea tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 946 time: 0.2912166
May 27 09:31:11.078842 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-6fc2ff9e-556c-446f-be41-bb18a730fc2c req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Deleting port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:31:11.079269 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-6fc2ff9e-556c-446f-be41-bb18a730fc2c req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:11.113157 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-36b91165-030b-442c-a69b-afb078270e39 req-09925626-c97f-41de-9c1d-e3f776188be8 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0766323
May 27 09:31:11.342190 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-6fc2ff9e-556c-446f-be41-bb18a730fc2c req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] For port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:31:11.342560 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-6fc2ff9e-556c-446f-be41-bb18a730fc2c req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:11.458951 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:11.507203 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-6fc2ff9e-556c-446f-be41-bb18a730fc2c req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Calling delete_port for e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:31:11.542681 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d835ab3b-f723-426f-a5ad-6c02583d34c2 req-581193dc-df18-4daf-8bcc-7ed575a584c1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:11.553035 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d835ab3b-f723-426f-a5ad-6c02583d34c2 req-581193dc-df18-4daf-8bcc-7ed575a584c1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.3264458
May 27 09:31:11.697819 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d835ab3b-f723-426f-a5ad-6c02583d34c2 req-f63c00f3-44e1-4002-8943-f88584ae6ecb tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1451542
May 27 09:31:11.853802 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a4d4f64-a67d-40f0-8088-1073339e7507 req-e74bd63b-e8bd-411b-be42-ffcceee2a581 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:11.855433 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6a4d4f64-a67d-40f0-8088-1073339e7507 req-e74bd63b-e8bd-411b-be42-ffcceee2a581 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=8164d612-dc97-4a3e-ab3b-0b55cc6032db HTTP/1.1" status: 200  len: 945 time: 0.2799401
May 27 09:31:11.864348 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5eca5bc6-6fb5-43b7-b7b8-3cf9c289e1d7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:11.967199 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6a4d4f64-a67d-40f0-8088-1073339e7507 req-8888c201-c328-4e4b-82a4-687abeaa6a0c tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1044850
May 27 09:31:11.969132 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-6fc2ff9e-556c-446f-be41-bb18a730fc2c req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:11.983827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:11.997053 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['61f95559-dc0a-4418-af09-fd9c84d973ac'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:31:12.036831 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Pushing event deleted for resources: {'Port': ['ID=e7cf8d12-6d8f-4d92-8664-d74ba281c8d2,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:12.077819 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.078242 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.078565 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.079804 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.080855 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.081258 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.081598 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.081960 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.082331 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.082680 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.083036 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.083442 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:12.096673 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:12.188120 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-6fc2ff9e-556c-446f-be41-bb18a730fc2c req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] No DVR routers for this DVR port e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:31:12.202850 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-6fc2ff9e-556c-446f-be41-bb18a730fc2c req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:12.217388 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8164d612-dc97-4a3e-ab3b-0b55cc6032db', 'name': 'network-vif-deleted', 'tag': 'e7cf8d12-6d8f-4d92-8664-d74ba281c8d2'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:31:12.242418 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6fc2ff9e-556c-446f-be41-bb18a730fc2c req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.11 "DELETE /v2.0/ports/e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 HTTP/1.1" status: 204  len: 173 time: 1.5410063
May 27 09:31:12.428907 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:12.474640 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288933e1-5783-4908-ae3c-cc917d25535e req-b648f452-bae4-4d52-9242-d3e64eee87a4 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:12.477195 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-288933e1-5783-4908-ae3c-cc917d25535e req-b648f452-bae4-4d52-9242-d3e64eee87a4 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2376933
May 27 09:31:12.497277 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a82c614c-c303-4e91-b1f6-09d510a9b939 req-5bff2649-289f-4fda-931f-0aa57c0221ed tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:12.500333 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a82c614c-c303-4e91-b1f6-09d510a9b939 req-5bff2649-289f-4fda-931f-0aa57c0221ed tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 946 time: 0.1983862
May 27 09:31:12.629275 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-288933e1-5783-4908-ae3c-cc917d25535e req-ac919f94-66eb-474c-9b30-d9df854c2805 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1270871
May 27 09:31:12.636533 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a82c614c-c303-4e91-b1f6-09d510a9b939 req-b4cff474-acd8-4f30-ac8b-402c6c40332a tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1083717
May 27 09:31:12.694035 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32f4600e-ea76-4629-941c-4d0b081553e3 req-45cc2067-cb63-4315-b925-99f165dac0dc tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:12.696382 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-32f4600e-ea76-4629-941c-4d0b081553e3 req-45cc2067-cb63-4315-b925-99f165dac0dc tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 946 time: 0.1340096
May 27 09:31:12.719840 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8164d612-dc97-4a3e-ab3b-0b55cc6032db', 'name': 'network-vif-deleted', 'tag': 'e7cf8d12-6d8f-4d92-8664-d74ba281c8d2', 'status': 'completed', 'code': 200}
May 27 09:31:12.941717 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-32f4600e-ea76-4629-941c-4d0b081553e3 req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Deleting port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:31:12.942077 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-32f4600e-ea76-4629-941c-4d0b081553e3 req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:12.963807 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b024855c-6399-4cf8-be88-06729511d727 req-4791a37c-556a-4eb1-89a4-04953deb6642 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:12.965666 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b024855c-6399-4cf8-be88-06729511d727 req-4791a37c-556a-4eb1-89a4-04953deb6642 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.1369963
May 27 09:31:13.183418 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b024855c-6399-4cf8-be88-06729511d727 req-0323390b-f3fc-4648-a583-596bf2131bc6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2034037
May 27 09:31:13.209146 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 494fef8d-4a46-4dc4-8bdc-d2550769b2dd no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:31:13.264068 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-32f4600e-ea76-4629-941c-4d0b081553e3 req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] For port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:31:13.264528 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-32f4600e-ea76-4629-941c-4d0b081553e3 req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:13.418071 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:13.463859 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '902defd6-871d-4189-bff2-6a0defa3a5ab', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '494fef8d-4a46-4dc4-8bdc-d2550769b2dd'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:31:13.480276 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:31:13.490894 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:13.492338 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:31:13.534851 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:13.538341 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-32f4600e-ea76-4629-941c-4d0b081553e3 req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Calling delete_port for 494fef8d-4a46-4dc4-8bdc-d2550769b2dd owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:31:13.572594 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:31:13.573153 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device e7cf8d12-6d8f-4d92-8664-d74ba281c8d2 not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:31:13.576310 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '902defd6-871d-4189-bff2-6a0defa3a5ab', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '494fef8d-4a46-4dc4-8bdc-d2550769b2dd', 'code': 200}
May 27 09:31:13.649392 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,revision_number=6']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:13.656819 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:13.845636 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-32f4600e-ea76-4629-941c-4d0b081553e3 req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:13.867239 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['2890994f-299e-4a4d-8e0a-945b6c38ecfe', '51dd2656-44f3-41cb-b4e3-38beccc875b4'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:31:13.892756 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-04297e14-5dfd-4042-b14b-62cce1039d3e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:13.984970 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-97f80481-4f2f-422c-8124-2452476c46e2 req-fcf08557-ca5b-482b-885b-f453e8ae577d tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=902defd6-871d-4189-bff2-6a0defa3a5ab HTTP/1.1" status: 200  len: 210 time: 0.1464560
May 27 09:31:13.986372 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Pushing event deleted for resources: {'Port': ['ID=494fef8d-4a46-4dc4-8bdc-d2550769b2dd,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:13.995204 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:14.075452 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-32f4600e-ea76-4629-941c-4d0b081553e3 req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] No DVR routers for this DVR port 494fef8d-4a46-4dc4-8bdc-d2550769b2dd on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:31:14.080015 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-32f4600e-ea76-4629-941c-4d0b081553e3 req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:14.109712 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-32f4600e-ea76-4629-941c-4d0b081553e3 req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "DELETE /v2.0/ports/494fef8d-4a46-4dc4-8bdc-d2550769b2dd HTTP/1.1" status: 204  len: 173 time: 1.3875124
May 27 09:31:14.127588 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa8c3470-5c32-433e-a5e7-1ab0d37f098a req-b0da0d03-de23-4091-b45c-742e6fa813f5 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:14.136571 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-aa8c3470-5c32-433e-a5e7-1ab0d37f098a req-b0da0d03-de23-4091-b45c-742e6fa813f5 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.3331776
May 27 09:31:14.252679 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-aa8c3470-5c32-433e-a5e7-1ab0d37f098a req-e6c8a1b0-9c4d-4231-bf42-c19f876f7ea5 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1150675
May 27 09:31:14.315890 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b2cf56-07d2-49a3-bf78-7316fc2b1ab0 req-b49bbbfd-5841-465f-a53b-fd60b33450be tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:14.319548 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-88b2cf56-07d2-49a3-bf78-7316fc2b1ab0 req-b49bbbfd-5841-465f-a53b-fd60b33450be tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Synchronizing usage tracker for tenant:e165c54223b24166b6856b6f285c4bca on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:31:14.359685 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-88b2cf56-07d2-49a3-bf78-7316fc2b1ab0 req-b49bbbfd-5841-465f-a53b-fd60b33450be tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Unset dirty status for tenant:e165c54223b24166b6856b6f285c4bca on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:31:14.362852 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-88b2cf56-07d2-49a3-bf78-7316fc2b1ab0 req-b49bbbfd-5841-465f-a53b-fd60b33450be tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.2232785
May 27 09:31:14.432430 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-88b2cf56-07d2-49a3-bf78-7316fc2b1ab0 req-fc4b2d4c-7805-4031-a4b9-e06fe5b3dd34 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0621645
May 27 09:31:14.523653 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ec891da-7a75-41e4-8acf-b51163623d39 req-631d06fc-74c1-4643-8c50-314b468c2112 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:14.526076 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9ec891da-7a75-41e4-8acf-b51163623d39 req-631d06fc-74c1-4643-8c50-314b468c2112 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 944 time: 0.0923822
May 27 09:31:14.581387 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9ec891da-7a75-41e4-8acf-b51163623d39 req-a228a501-0e1d-4fd3-988d-3669b1dfb7fa tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0423949
May 27 09:31:14.722420 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '902defd6-871d-4189-bff2-6a0defa3a5ab', 'name': 'network-vif-deleted', 'tag': '494fef8d-4a46-4dc4-8bdc-d2550769b2dd'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:31:14.781871 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '902defd6-871d-4189-bff2-6a0defa3a5ab', 'name': 'network-vif-deleted', 'tag': '494fef8d-4a46-4dc4-8bdc-d2550769b2dd', 'status': 'completed', 'code': 200}
May 27 09:31:14.923699 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:15.094569 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:31:15.222203 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:31:15.419708 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:31:15.460160 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'port_id': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'mac_address': 'fa:16:3e:70:e3:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 396, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:31:15.548685 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:15.567721 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:31:15.583941 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:31:15.587890 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:15.588048 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa41eaf4-0a38-489b-8231-a773d3c94993 req-7f230587-aceb-427f-a876-c4c9d9fd3fa7 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:15.589542 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fa41eaf4-0a38-489b-8231-a773d3c94993 req-7f230587-aceb-427f-a876-c4c9d9fd3fa7 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1915188
May 27 09:31:15.589667 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:15.631158 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e333a30-a765-458d-933c-91ee2a4164e9 req-d2a54d2f-d1fb-459e-b03a-55e2bd4328e9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:15.631849 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-5e333a30-a765-458d-933c-91ee2a4164e9 req-d2a54d2f-d1fb-459e-b03a-55e2bd4328e9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Synchronizing usage tracker for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:31:15.663423 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fa41eaf4-0a38-489b-8231-a773d3c94993 req-80840bca-11af-4a53-808d-6e1c1440413a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0651081
May 27 09:31:15.668050 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-5e333a30-a765-458d-933c-91ee2a4164e9 req-d2a54d2f-d1fb-459e-b03a-55e2bd4328e9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Unset dirty status for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:31:15.669305 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5e333a30-a765-458d-933c-91ee2a4164e9 req-d2a54d2f-d1fb-459e-b03a-55e2bd4328e9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 945 time: 0.2094893
May 27 09:31:15.686920 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,revision_number=9']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:15.697976 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.698562 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.699596 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.700110 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.700739 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.701233 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.701748 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.702354 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.702841 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.703326 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.703877 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.704905 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:15.712391 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:15.721674 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5e333a30-a765-458d-933c-91ee2a4164e9 req-3929f68c-37c1-4763-9bde-0bc8991af499 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0455582
May 27 09:31:15.863428 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aff466c5-4217-447f-b458-74551466c4ea req-f88d67b1-d26b-46ca-9795-81f2e9fcc938 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:15.864912 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-aff466c5-4217-447f-b458-74551466c4ea req-f88d67b1-d26b-46ca-9795-81f2e9fcc938 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.0911748
May 27 09:31:15.965315 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-aff466c5-4217-447f-b458-74551466c4ea req-b20adddb-529e-4082-8e60-2a0cbe4b51a3 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0674551
May 27 09:31:15.986029 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-772ed728-91ae-4393-986e-c8dab2da57c6 req-6a86d92e-5e78-4297-af5a-ec96b2012a05 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:15.987588 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-772ed728-91ae-4393-986e-c8dab2da57c6 req-6a86d92e-5e78-4297-af5a-ec96b2012a05 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 945 time: 0.1217406
May 27 09:31:15.990079 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['6c2d447f-c9da-40aa-a848-6fcbf0beecb3'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:31:16.034270 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-772ed728-91ae-4393-986e-c8dab2da57c6 req-81830aa3-2e24-4da0-99a4-7103ce82d412 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404239
May 27 09:31:16.920087 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd5f492-83e7-472d-b4e8-98ebce928c11 req-b5571ff4-883e-4ee5-aac3-c6c755156c7c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:16.921668 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1bd5f492-83e7-472d-b4e8-98ebce928c11 req-b5571ff4-883e-4ee5-aac3-c6c755156c7c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1461730
May 27 09:31:16.989770 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf0e458-ceba-477a-898e-fae3181f3ee9 req-e4885751-eb17-4a97-8ab8-c11f7f711c05 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:16.991352 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-caf0e458-ceba-477a-898e-fae3181f3ee9 req-e4885751-eb17-4a97-8ab8-c11f7f711c05 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 945 time: 0.1515291
May 27 09:31:16.996402 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1bd5f492-83e7-472d-b4e8-98ebce928c11 req-5a036f0f-2228-45e9-8351-f5dacba59b0c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0665987
May 27 09:31:17.047067 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-caf0e458-ceba-477a-898e-fae3181f3ee9 req-a1b677e5-84a7-49bf-bc45-7c4fc1017a62 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0497181
May 27 09:31:17.237801 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:31:17.287181 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e92f8ec-5580-4bc3-96a5-992b3e4efe99 req-678cef30-fe6b-4373-b1f5-88c1b8b11874 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:17.288711 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1e92f8ec-5580-4bc3-96a5-992b3e4efe99 req-678cef30-fe6b-4373-b1f5-88c1b8b11874 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1959252
May 27 09:31:17.315269 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:31:17.315682 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:17.326113 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f8f5bd3-3c4f-46ed-b4df-74662a058e56 req-c4f0a42a-4839-4a01-a375-e15008a685bd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:17.327642 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9f8f5bd3-3c4f-46ed-b4df-74662a058e56 req-c4f0a42a-4839-4a01-a375-e15008a685bd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 945 time: 0.1662049
May 27 09:31:17.430256 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1e92f8ec-5580-4bc3-96a5-992b3e4efe99 req-97ef6ef6-295a-4075-9b69-aa5b4e7a1a17 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1349473
May 27 09:31:17.479355 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9f8f5bd3-3c4f-46ed-b4df-74662a058e56 req-56431840-3947-4024-b143-75bcdec3befb tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1364686
May 27 09:31:17.488893 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:17.526252 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:31:17.538545 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:31:17.550737 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a27061e1-4dc5-46a7-a1e4-600ba7888913 req-c9372db9-5879-4ac8-871d-11769653fe38 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:17.550890 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:17.553266 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:17.556257 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a27061e1-4dc5-46a7-a1e4-600ba7888913 req-c9372db9-5879-4ac8-871d-11769653fe38 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 945 time: 0.1733851
May 27 09:31:17.586904 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'code': 200}
May 27 09:31:17.654710 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,revision_number=10']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:17.673486 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:17.827846 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-a27061e1-4dc5-46a7-a1e4-600ba7888913 req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Deleting port 51dd2656-44f3-41cb-b4e3-38beccc875b4 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:31:17.827846 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a27061e1-4dc5-46a7-a1e4-600ba7888913 req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:17.982282 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-a27061e1-4dc5-46a7-a1e4-600ba7888913 req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] For port 51dd2656-44f3-41cb-b4e3-38beccc875b4, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=51dd2656-44f3-41cb-b4e3-38beccc875b4,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:31:17.982963 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a27061e1-4dc5-46a7-a1e4-600ba7888913 req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:18.112950 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-a27061e1-4dc5-46a7-a1e4-600ba7888913 req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Calling delete_port for 51dd2656-44f3-41cb-b4e3-38beccc875b4 owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:31:18.168201 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-099a8b34-801d-4447-ad84-8e5ffb7d21ea req-31fa6294-62f7-4fa9-b189-d034c31a6c4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:18.169676 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-099a8b34-801d-4447-ad84-8e5ffb7d21ea req-31fa6294-62f7-4fa9-b189-d034c31a6c4e service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 1100 time: 0.0765696
May 27 09:31:18.221618 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-099a8b34-801d-4447-ad84-8e5ffb7d21ea req-621abdb9-3701-44ae-bd77-cf261b8d7400 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0374899
May 27 09:31:18.347271 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f0d60fe-83e8-4f29-ab5a-41abdde088ce req-dec17a80-58e4-44eb-893c-bb6fda0a6409 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:18.348729 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8f0d60fe-83e8-4f29-ab5a-41abdde088ce req-dec17a80-58e4-44eb-893c-bb6fda0a6409 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2163634
May 27 09:31:18.395024 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bfa2325-56f0-4893-b6ba-b54104d0826c req-7d53907f-36d8-4294-93e2-5fccb3c00590 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:18.396585 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7bfa2325-56f0-4893-b6ba-b54104d0826c req-7d53907f-36d8-4294-93e2-5fccb3c00590 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=e7d36019-4501-44b8-99c4-ff2d84aef03c HTTP/1.1" status: 200  len: 945 time: 0.2155588
May 27 09:31:18.415216 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a27061e1-4dc5-46a7-a1e4-600ba7888913 req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:18.429105 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['2890994f-299e-4a4d-8e0a-945b6c38ecfe', '51dd2656-44f3-41cb-b4e3-38beccc875b4'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:31:18.437535 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:18.510358 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8f0d60fe-83e8-4f29-ab5a-41abdde088ce req-2c90651b-1d88-42b2-b3bf-b8b40414effc tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1531117
May 27 09:31:18.511140 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Pushing event deleted for resources: {'Port': ['ID=51dd2656-44f3-41cb-b4e3-38beccc875b4,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:18.516509 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:18.603165 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7bfa2325-56f0-4893-b6ba-b54104d0826c req-71ddc2e5-c946-450b-966a-a130052dac3f tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1929517
May 27 09:31:18.623397 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-a27061e1-4dc5-46a7-a1e4-600ba7888913 req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] No DVR routers for this DVR port 51dd2656-44f3-41cb-b4e3-38beccc875b4 on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:31:18.629141 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-a27061e1-4dc5-46a7-a1e4-600ba7888913 req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:18.643877 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e7d36019-4501-44b8-99c4-ff2d84aef03c', 'name': 'network-vif-deleted', 'tag': '51dd2656-44f3-41cb-b4e3-38beccc875b4'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:31:18.663286 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a27061e1-4dc5-46a7-a1e4-600ba7888913 req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "DELETE /v2.0/ports/51dd2656-44f3-41cb-b4e3-38beccc875b4 HTTP/1.1" status: 204  len: 173 time: 1.0994408
May 27 09:31:18.835753 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f7651a7-4fc5-47b8-87f1-3d24084af141 req-3414852e-9dfb-4262-84a8-78db1992b91f tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:18.839539 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1f7651a7-4fc5-47b8-87f1-3d24084af141 req-3414852e-9dfb-4262-84a8-78db1992b91f tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1562760
May 27 09:31:18.997104 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1f7651a7-4fc5-47b8-87f1-3d24084af141 req-462e99dd-db80-4b63-abe6-dc1a11a9d14d tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0646176
May 27 09:31:19.021301 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23ad1b2-6d19-476f-872e-1015c621635b req-ae5649b8-c2f9-4970-a668-37c229cb94fb tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:19.023187 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a23ad1b2-6d19-476f-872e-1015c621635b req-ae5649b8-c2f9-4970-a668-37c229cb94fb tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 947 time: 0.1820097
May 27 09:31:19.070054 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e7d36019-4501-44b8-99c4-ff2d84aef03c', 'name': 'network-vif-deleted', 'tag': '51dd2656-44f3-41cb-b4e3-38beccc875b4', 'status': 'completed', 'code': 200}
May 27 09:31:19.083155 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a23ad1b2-6d19-476f-872e-1015c621635b req-5804101a-708a-4129-86f8-e12a3f967735 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0533264
May 27 09:31:19.134538 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52526) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:19.335488 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ee9b96ef-052c-41ec-961e-bd99adc77477 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:19.354717 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-ee9b96ef-052c-41ec-961e-bd99adc77477 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:31:19.358714 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-ee9b96ef-052c-41ec-961e-bd99adc77477 admin admin] Usage tracker for resource:security_group_rule and tenant:50f73805a9824439a87d5f20bc2c42de is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:31:19.361743 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-ee9b96ef-052c-41ec-961e-bd99adc77477 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:31:19.367924 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-ee9b96ef-052c-41ec-961e-bd99adc77477 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:31:19.466581 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ee9b96ef-052c-41ec-961e-bd99adc77477 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:19.471779 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ee9b96ef-052c-41ec-961e-bd99adc77477 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:19.479476 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-87663148-7c50-4a4b-8f3a-6fb87bdde830 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:19.529109 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-ee9b96ef-052c-41ec-961e-bd99adc77477 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=50f73805a9824439a87d5f20bc2c42de&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3934588
May 27 09:31:19.529572 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52534) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:19.530300 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee9b96ef-052c-41ec-961e-bd99adc77477 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b91307d-1a6f-46ff-8743-9bdf9ac03e77,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:19.534216 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ee9b96ef-052c-41ec-961e-bd99adc77477 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:19.700302 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:19.771999 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:19.893038 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:19.898387 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-79968318-cbad-4957-bdfd-f3d30ba7b440 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:19.928426 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b91307d-1a6f-46ff-8743-9bdf9ac03e77,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:19.944252 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.944922 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.945448 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.946016 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.946545 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.947060 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.947600 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.948150 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.948686 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.949205 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.949713 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.950246 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:31:19.957582 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:19.958759 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:19.963927 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-61d7ae8f-b732-490a-a4e6-052a5998d2e4 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8b91307d-1a6f-46ff-8743-9bdf9ac03e77 HTTP/1.1" status: 204  len: 168 time: 0.4302802
May 27 09:31:20.072808 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5609118f-1fea-4a1c-959b-6f1835f5c1a5 req-e3b0dcc2-06fa-4d4f-9737-698a658d6c1a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:20.083241 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5609118f-1fea-4a1c-959b-6f1835f5c1a5 req-e3b0dcc2-06fa-4d4f-9737-698a658d6c1a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2203851
May 27 09:31:20.296056 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5609118f-1fea-4a1c-959b-6f1835f5c1a5 req-7261cb3b-dce4-435d-be77-4478bbe168f4 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1966627
May 27 09:31:20.385844 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc111e9-db33-474f-96e8-ed6727966d11 req-789a35ac-e258-4313-b3e5-7730afc835e1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:20.389279 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8dc111e9-db33-474f-96e8-ed6727966d11 req-789a35ac-e258-4313-b3e5-7730afc835e1 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.1915152
May 27 09:31:20.452395 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8dc111e9-db33-474f-96e8-ed6727966d11 req-96a75a59-7bd7-42a8-9efe-58ff94562084 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0539517
May 27 09:31:20.612155 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3434dbab-a520-49f3-9249-744a71444550 req-c1191f90-7978-4108-a7d0-428caa817fe9 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:20.614205 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3434dbab-a520-49f3-9249-744a71444550 req-c1191f90-7978-4108-a7d0-428caa817fe9 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 947 time: 0.1164405
May 27 09:31:20.671919 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3434dbab-a520-49f3-9249-744a71444550 req-a332d857-a049-4e88-af88-9b8c0a4ecf85 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0512342
May 27 09:31:21.152480 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-149b1c80-0711-40fb-b3cb-a7f277a48c1f req-800281e5-edd2-471f-a948-d478accffd0a tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:21.153803 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-149b1c80-0711-40fb-b3cb-a7f277a48c1f req-800281e5-edd2-471f-a948-d478accffd0a tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.11 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.0828898
May 27 09:31:21.267961 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 51dd2656-44f3-41cb-b4e3-38beccc875b4 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:31:21.299189 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-149b1c80-0711-40fb-b3cb-a7f277a48c1f req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Deleting port 61f95559-dc0a-4418-af09-fd9c84d973ac {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:31:21.299857 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-149b1c80-0711-40fb-b3cb-a7f277a48c1f req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:21.301468 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 51dd2656-44f3-41cb-b4e3-38beccc875b4 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:31:21.301820 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 51dd2656-44f3-41cb-b4e3-38beccc875b4 not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:31:21.612744 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-149b1c80-0711-40fb-b3cb-a7f277a48c1f req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] For port 61f95559-dc0a-4418-af09-fd9c84d973ac, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=61f95559-dc0a-4418-af09-fd9c84d973ac,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:31:21.613223 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-149b1c80-0711-40fb-b3cb-a7f277a48c1f req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:21.775628 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f179c36-0669-4bfa-a716-ddb2144434c7 req-7e40e6e4-b38c-481e-9d51-a7b1dd1e8515 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:21.777128 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9f179c36-0669-4bfa-a716-ddb2144434c7 req-7e40e6e4-b38c-481e-9d51-a7b1dd1e8515 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2990570
May 27 09:31:21.788786 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-149b1c80-0711-40fb-b3cb-a7f277a48c1f req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Calling delete_port for 61f95559-dc0a-4418-af09-fd9c84d973ac owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:31:21.880567 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9f179c36-0669-4bfa-a716-ddb2144434c7 req-5e8a8014-0dbb-464c-aaa8-ae69688be6d0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0845869
May 27 09:31:21.916178 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3653e83e-4935-4fa1-9002-0f24c9a26ddb req-22385661-ecd3-40ff-bc41-12ef3cab237b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:21.917732 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3653e83e-4935-4fa1-9002-0f24c9a26ddb req-22385661-ecd3-40ff-bc41-12ef3cab237b tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/ports?device_id=4f6ec86c-fb8e-442b-b20f-de58d342e4c8 HTTP/1.1" status: 200  len: 945 time: 0.2384272
May 27 09:31:22.074811 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3653e83e-4935-4fa1-9002-0f24c9a26ddb req-6e6feacb-439b-4be6-bd04-49e613a0ca66 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.30 "GET /v2.0/security-groups?id=8b092a0d-7e7a-44dd-89d6-e037e6befb57&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1473508
May 27 09:31:22.093647 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-149b1c80-0711-40fb-b3cb-a7f277a48c1f req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:22.101229 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ef4b7cf9-8868-45d3-ade8-f1d214b2d312 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:22.108528 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['61f95559-dc0a-4418-af09-fd9c84d973ac'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:31:22.151466 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Pushing event deleted for resources: {'Port': ['ID=61f95559-dc0a-4418-af09-fd9c84d973ac,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:22.157581 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:22.284462 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d8ceeea-07e7-4aff-9bc7-689620e3cc40 req-f3132c27-43ea-409b-983a-541abb17d74c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:22.285430 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-4d8ceeea-07e7-4aff-9bc7-689620e3cc40 req-f3132c27-43ea-409b-983a-541abb17d74c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Synchronizing usage tracker for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:31:22.292742 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-149b1c80-0711-40fb-b3cb-a7f277a48c1f req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] No DVR routers for this DVR port 61f95559-dc0a-4418-af09-fd9c84d973ac on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:31:22.298847 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-149b1c80-0711-40fb-b3cb-a7f277a48c1f req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:22.301431 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4f6ec86c-fb8e-442b-b20f-de58d342e4c8', 'name': 'network-vif-deleted', 'tag': '61f95559-dc0a-4418-af09-fd9c84d973ac'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:31:22.336086 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-4d8ceeea-07e7-4aff-9bc7-689620e3cc40 req-f3132c27-43ea-409b-983a-541abb17d74c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Unset dirty status for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:31:22.336086 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4d8ceeea-07e7-4aff-9bc7-689620e3cc40 req-f3132c27-43ea-409b-983a-541abb17d74c tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 945 time: 0.3409746
May 27 09:31:22.346811 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-149b1c80-0711-40fb-b3cb-a7f277a48c1f req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] 10.222.0.11 "DELETE /v2.0/ports/61f95559-dc0a-4418-af09-fd9c84d973ac HTTP/1.1" status: 204  len: 173 time: 1.1870775
May 27 09:31:22.405883 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8965d944-c4df-4a67-8eed-38c160d8469a req-e776d4dc-75fe-4e0b-b820-78a5d53806e0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:22.407968 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8965d944-c4df-4a67-8eed-38c160d8469a req-e776d4dc-75fe-4e0b-b820-78a5d53806e0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 947 time: 0.2172782
May 27 09:31:22.435841 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4d8ceeea-07e7-4aff-9bc7-689620e3cc40 req-3588c01e-a110-4f02-8059-44c42337ca9e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0919778
May 27 09:31:22.467456 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8965d944-c4df-4a67-8eed-38c160d8469a req-553fe8c8-ca7b-4e2c-bfe7-2eca42548aa6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0506759
May 27 09:31:22.492678 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4f6ec86c-fb8e-442b-b20f-de58d342e4c8', 'name': 'network-vif-deleted', 'tag': '61f95559-dc0a-4418-af09-fd9c84d973ac', 'status': 'completed', 'code': 200}
May 27 09:31:23.093232 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54ebabd2-596e-4316-aaca-b26424f06cf3 req-34b8856a-c9b6-4055-817e-ec43bbfef045 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:23.095852 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-54ebabd2-596e-4316-aaca-b26424f06cf3 req-34b8856a-c9b6-4055-817e-ec43bbfef045 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.0925229
May 27 09:31:23.151496 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-54ebabd2-596e-4316-aaca-b26424f06cf3 req-33ef26dc-b958-46c4-b826-3c5731c8c2ef tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0473766
May 27 09:31:23.182021 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52616) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:23.681129 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0c2fc14-b8da-453a-b2e1-33a2a98124d0 req-118a8d71-db2e-4753-a4a3-f7aac5310121 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:23.682872 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b0c2fc14-b8da-453a-b2e1-33a2a98124d0 req-118a8d71-db2e-4753-a4a3-f7aac5310121 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 945 time: 0.1622210
May 27 09:31:23.694342 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e8397d0-dbac-4a90-874a-b71c8739e902 req-cef9ace0-147c-4695-ae45-699c03221ee0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:23.695793 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1e8397d0-dbac-4a90-874a-b71c8739e902 req-cef9ace0-147c-4695-ae45-699c03221ee0 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 945 time: 0.1362493
May 27 09:31:23.813594 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3816697'] for router_interface, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:23.842477 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1e8397d0-dbac-4a90-874a-b71c8739e902 req-2629ead0-0abe-401a-8494-87094b63fe8e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/security-groups?id=48e9e898-8ba6-494b-b4a6-c29df60938f6&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1045065
May 27 09:31:23.899361 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-b0c2fc14-b8da-453a-b2e1-33a2a98124d0 req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Deleting port 2890994f-299e-4a4d-8e0a-945b6c38ecfe {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:31:23.899733 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-b0c2fc14-b8da-453a-b2e1-33a2a98124d0 req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:24.052119 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-b0c2fc14-b8da-453a-b2e1-33a2a98124d0 req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] For port 2890994f-299e-4a4d-8e0a-945b6c38ecfe, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=2890994f-299e-4a4d-8e0a-945b6c38ecfe,segment=NetworkSegment(5cc9fe82-a594-45e0-8c16-9cade14c2ef5),segment_id=5cc9fe82-a594-45e0-8c16-9cade14c2ef5)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:31:24.052375 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-b0c2fc14-b8da-453a-b2e1-33a2a98124d0 req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:24.185838 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-b0c2fc14-b8da-453a-b2e1-33a2a98124d0 req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Calling delete_port for 2890994f-299e-4a4d-8e0a-945b6c38ecfe owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:31:24.361718 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Deleting port d9d28434-09e7-48ed-9844-ef965b2d090b {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:31:24.362285 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:24.469532 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-b0c2fc14-b8da-453a-b2e1-33a2a98124d0 req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:24.477574 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:24.486793 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['2890994f-299e-4a4d-8e0a-945b6c38ecfe'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:31:24.501992 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] For port d9d28434-09e7-48ed-9844-ef965b2d090b, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=d9d28434-09e7-48ed-9844-ef965b2d090b,segment=NetworkSegment(bd8c1b0f-c94a-4b60-a7ce-94548ae35a54),segment_id=bd8c1b0f-c94a-4b60-a7ce-94548ae35a54)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:31:24.502355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:24.537226 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Pushing event deleted for resources: {'Port': ['ID=2890994f-299e-4a4d-8e0a-945b6c38ecfe,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:24.578658 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:24.596035 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3581bf89-f38c-4a83-86cb-7a43a3b47397 req-4c8dc462-c549-4575-9938-ea55b2c9a8b9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:24.603218 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3581bf89-f38c-4a83-86cb-7a43a3b47397 req-4c8dc462-c549-4575-9938-ea55b2c9a8b9 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2349532
May 27 09:31:24.647136 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Calling delete_port for d9d28434-09e7-48ed-9844-ef965b2d090b owned by network:router_interface {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:31:24.661684 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-b0c2fc14-b8da-453a-b2e1-33a2a98124d0 req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] No DVR routers for this DVR port 2890994f-299e-4a4d-8e0a-945b6c38ecfe on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:31:24.665751 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-b0c2fc14-b8da-453a-b2e1-33a2a98124d0 req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:24.668299 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '771c169e-ea25-4862-a057-69f990bb8eab', 'name': 'network-vif-deleted', 'tag': '2890994f-299e-4a4d-8e0a-945b6c38ecfe'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:31:24.694203 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b0c2fc14-b8da-453a-b2e1-33a2a98124d0 req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.11 "DELETE /v2.0/ports/2890994f-299e-4a4d-8e0a-945b6c38ecfe HTTP/1.1" status: 204  len: 173 time: 0.9974096
May 27 09:31:24.701653 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3581bf89-f38c-4a83-86cb-7a43a3b47397 req-78d520fb-e338-42b2-9e55-7f9fd11f8343 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0975611
May 27 09:31:24.733040 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '771c169e-ea25-4862-a057-69f990bb8eab', 'name': 'network-vif-deleted', 'tag': '2890994f-299e-4a4d-8e0a-945b6c38ecfe', 'status': 'completed', 'code': 200}
May 27 09:31:25.011721 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:25.016995 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:25.018358 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-39ef69a8-0f6d-4ffb-8aaf-d7e3045e6c4d req-46d07c77-fb8b-454b-8abb-39394be0995e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Synchronizing usage tracker for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:31:25.034758 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-39ef69a8-0f6d-4ffb-8aaf-d7e3045e6c4d req-46d07c77-fb8b-454b-8abb-39394be0995e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Unset dirty status for tenant:0daf73d9a2424c3e9ccbe74a9d2d94f5 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:31:25.035961 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-39ef69a8-0f6d-4ffb-8aaf-d7e3045e6c4d req-46d07c77-fb8b-454b-8abb-39394be0995e tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] 10.222.0.30 "GET /v2.0/ports?device_id=771c169e-ea25-4862-a057-69f990bb8eab HTTP/1.1" status: 200  len: 210 time: 0.0615096
May 27 09:31:25.067656 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Pushing event deleted for resources: {'Port': ['ID=d9d28434-09e7-48ed-9844-ef965b2d090b,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:25.072168 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.055s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:25.300510 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 61f95559-dc0a-4418-af09-fd9c84d973ac no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:31:25.337399 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 61f95559-dc0a-4418-af09-fd9c84d973ac {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:31:25.337860 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 61f95559-dc0a-4418-af09-fd9c84d973ac not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:31:25.353977 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3683824', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3812169'] for router_interface, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:25.918694 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:31:25.983105 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-54530b7c-441a-4180-96cf-1bc438a1e48c service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1424274
May 27 09:31:26.102491 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f7eb61a-d87b-42b6-bcaa-09c3fc54b369 req-5918361b-1452-4e34-9ffc-bbf510455c3a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:26.104264 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9f7eb61a-d87b-42b6-bcaa-09c3fc54b369 req-5918361b-1452-4e34-9ffc-bbf510455c3a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1768749
May 27 09:31:26.217544 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9f7eb61a-d87b-42b6-bcaa-09c3fc54b369 req-82346768-e107-42dd-85a3-1b19e8ba8bb1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1025989
May 27 09:31:26.229597 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52650) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:26.233284 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:31:26.244257 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-509acbdf-0a03-463a-9c83-fd7740d6f9fb None None] Sync routers for ids ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:31:26.258197 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] 10.222.0.30 "PUT /v2.0/routers/fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.0715132
May 27 09:31:26.258651 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52654) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:26.262996 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-509acbdf-0a03-463a-9c83-fd7740d6f9fb None None] Routers {'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:31:26.263959 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-509acbdf-0a03-463a-9c83-fd7740d6f9fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecac94c0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:31:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:26.301591 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-3e394f4f-807e-48fe-ba1f-dc3384613e23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:26.303191 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-3e394f4f-807e-48fe-ba1f-dc3384613e23 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 1100 time: 0.2876694
May 27 09:31:26.363209 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_v2 [None req-1250e34f-2ce7-414c-a9e7-9ca8163fd7dc admin admin] Deleting subnet 3d70d479-f390-4cd8-90ff-49a918615aa4 {{(pid=91821) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:31:26.372848 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1250e34f-2ce7-414c-a9e7-9ca8163fd7dc admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:26.411991 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:26.470610 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-509acbdf-0a03-463a-9c83-fd7740d6f9fb None None] Set router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:31:26.567077 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Notify callbacks [] for router, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:26.576881 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-3d491bdb-07dc-418e-b870-cf7048eba85f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:26.578533 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-3d491bdb-07dc-418e-b870-cf7048eba85f service neutron] 10.222.0.11 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 917 time: 0.2456481
May 27 09:31:26.581729 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1250e34f-2ce7-414c-a9e7-9ca8163fd7dc admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2232147'] for subnet, precommit_delete_associations {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:26.823935 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1250e34f-2ce7-414c-a9e7-9ca8163fd7dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:26.830746 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-509acbdf-0a03-463a-9c83-fd7740d6f9fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecac94c0>, [{'id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-router', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89'}], 'enable_snat': True}, 'gw_port_id': '8262e930-0850-4885-81df-37a7db4afa6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:31:24Z', 'revision_number': 5, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'gw_port': {'id': '8262e930-0850-4885-81df-37a7db4afa6d', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:22:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:10Z', 'updated_at': '2021-05-27T09:27:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:26.836176 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-509acbdf-0a03-463a-9c83-fd7740d6f9fb None None] Checking router: fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:31:26.849230 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-509acbdf-0a03-463a-9c83-fd7740d6f9fb None None] Routers {'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:31:26.849900 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-509acbdf-0a03-463a-9c83-fd7740d6f9fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecac94c0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:31:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:26.859861 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-ce9bcf48-8d3b-4f1f-8dad-f3921f8ce5b4 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3 HTTP/1.1" status: 200  len: 1001 time: 0.2457905
May 27 09:31:26.940470 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5ccb80e-eb3f-4e26-b1d9-0db3528ae2c0 req-f69cc2c2-ddd2-47fc-b2f4-ac4a5c2e33b3 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:26.940987 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c5ccb80e-eb3f-4e26-b1d9-0db3528ae2c0 req-f69cc2c2-ddd2-47fc-b2f4-ac4a5c2e33b3 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2436054
May 27 09:31:26.964211 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c059d97-8efb-4a33-b4c4-df8344435c3e req-7e3a5b06-d6f0-4154-8f1a-b2794923b8e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:26.968927 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5c059d97-8efb-4a33-b4c4-df8344435c3e req-7e3a5b06-d6f0-4154-8f1a-b2794923b8e6 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 1098 time: 0.2359252
May 27 09:31:26.998856 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-77281cde-576c-41ce-a6e1-deff06ebf720 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:27.000363 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-77281cde-576c-41ce-a6e1-deff06ebf720 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 200  len: 855 time: 0.1246660
May 27 09:31:27.027849 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:27.174002 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-509acbdf-0a03-463a-9c83-fd7740d6f9fb None None] Set router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:31:27.178999 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c5ccb80e-eb3f-4e26-b1d9-0db3528ae2c0 req-2d7970b2-dc93-43d7-9e1d-d88739a5b843 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2301610
May 27 09:31:27.251509 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c059d97-8efb-4a33-b4c4-df8344435c3e req-6099e915-4aa9-45e0-8b5e-cf8d2085a472 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:27.253736 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5c059d97-8efb-4a33-b4c4-df8344435c3e req-6099e915-4aa9-45e0-8b5e-cf8d2085a472 service neutron] 10.222.0.11 "GET /v2.0/networks?id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 200  len: 912 time: 0.2764022
May 27 09:31:27.267434 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Deleting port 8262e930-0850-4885-81df-37a7db4afa6d {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:31:27.267434 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:27.303637 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 2890994f-299e-4a4d-8e0a-945b6c38ecfe no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:31:27.312301 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-9dab5a11-820c-4bb3-83a4-429ad1ca49dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:27.313977 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-9dab5a11-820c-4bb3-83a4-429ad1ca49dd service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=624aa867-a71e-4343-8899-4e49257cd000&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2460382
May 27 09:31:27.353704 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 2890994f-299e-4a4d-8e0a-945b6c38ecfe {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:31:27.354568 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 2890994f-299e-4a4d-8e0a-945b6c38ecfe not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:31:27.513752 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5c059d97-8efb-4a33-b4c4-df8344435c3e req-f6f4b0b3-cf42-46d0-81a9-2c6035240a9f service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=5c6508e0-a5e3-49f0-adc0-fd87845be346 HTTP/1.1" status: 200  len: 1001 time: 0.2249873
May 27 09:31:27.564263 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1250e34f-2ce7-414c-a9e7-9ca8163fd7dc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2158057', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2399650'] for subnet, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:27.582949 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:27.595796 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] For port 8262e930-0850-4885-81df-37a7db4afa6d, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=8262e930-0850-4885-81df-37a7db4afa6d,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:31:27.596212 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:27.626664 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1250e34f-2ce7-414c-a9e7-9ca8163fd7dc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3d70d479-f390-4cd8-90ff-49a918615aa4,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:27.634014 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-1250e34f-2ce7-414c-a9e7-9ca8163fd7dc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:27.640547 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1250e34f-2ce7-414c-a9e7-9ca8163fd7dc admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:27.666041 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-509acbdf-0a03-463a-9c83-fd7740d6f9fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecac94c0>, [{'id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-router', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89'}], 'enable_snat': True}, 'gw_port_id': '8262e930-0850-4885-81df-37a7db4afa6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:31:24Z', 'revision_number': 5, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'gw_port': {'id': '8262e930-0850-4885-81df-37a7db4afa6d', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:22:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:10Z', 'updated_at': '2021-05-27T09:27:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:27.676991 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-509acbdf-0a03-463a-9c83-fd7740d6f9fb None None] The sync data for ids ['fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0'] in dv-cinder-772623-6-iscsi is: [{'id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'name': 'tempest-ServerRescueNegativeTestJSON-1736103413-router', 'tenant_id': 'e165c54223b24166b6856b6f285c4bca', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89'}], 'enable_snat': True}, 'gw_port_id': '8262e930-0850-4885-81df-37a7db4afa6d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:31:24Z', 'revision_number': 5, 'project_id': 'e165c54223b24166b6856b6f285c4bca', 'gw_port': {'id': '8262e930-0850-4885-81df-37a7db4afa6d', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:d7:22:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.89', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:10Z', 'updated_at': '2021-05-27T09:27:36Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:31:27.683418 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-1250e34f-2ce7-414c-a9e7-9ca8163fd7dc admin admin] 10.222.0.30 "DELETE /v2.0/subnets/3d70d479-f390-4cd8-90ff-49a918615aa4 HTTP/1.1" status: 204  len: 168 time: 1.4510953
May 27 09:31:27.695536 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52664) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:27.733762 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-f51b48ec-b34e-4d1f-b3b5-70051be5163a service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3725727
May 27 09:31:27.856890 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Calling delete_port for 8262e930-0850-4885-81df-37a7db4afa6d owned by network:router_gateway {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:31:27.866236 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c059d97-8efb-4a33-b4c4-df8344435c3e req-97521cd1-6de9-4228-ad49-d3774170c6b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:27.867719 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5c059d97-8efb-4a33-b4c4-df8344435c3e req-97521cd1-6de9-4228-ad49-d3774170c6b6 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b2c650ce-3329-4545-aaac-c69109472b2b HTTP/1.1" status: 200  len: 850 time: 0.3341773
May 27 09:31:27.939693 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:27.983596 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c059d97-8efb-4a33-b4c4-df8344435c3e req-abe26d72-15cd-422b-85d0-4af6e9527c4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:27.984945 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5c059d97-8efb-4a33-b4c4-df8344435c3e req-abe26d72-15cd-422b-85d0-4af6e9527c4a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1031923
May 27 09:31:28.143315 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3663f9de-82b6-4cbf-b0c7-4118f382ddb4 req-1ef77eea-f5e7-4531-870e-da850366519e service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3563454
May 27 09:31:28.171246 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.192129 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2eec014cd0>,) {'filters': {'network_id': ['7cbf7538-2626-435d-83dd-e10fb0c9e965']}} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:28.239190 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec014cd0>, '5cc9fe82-a594-45e0-8c16-9cade14c2ef5') {'for_net_delete': True} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:28.239665 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec014cd0>, '5cc9fe82-a594-45e0-8c16-9cade14c2ef5') {} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:28.243194 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device d9d28434-09e7-48ed-9844-ef965b2d090b no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:31:28.258254 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2232170'] for segment, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.274722 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5c059d97-8efb-4a33-b4c4-df8344435c3e req-1147d66e-9f88-458a-8412-0e15ef91a4fc service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2818463
May 27 09:31:28.288120 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.300394 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] Releasing vlan 386 on physical network physnet1 to pool {{(pid=91821) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:31:28.300918 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2157387'] for segment, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.320856 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.329736 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ceeb8b62-78d5-4bc2-af4a-10cef434050b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]: Traceback (most recent call last):
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     timer()
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     cb(*args, **kw)
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     return func(*args, **kwargs)
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     self._notify()
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     self.callback(batched_events)
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     event.method(event)
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     return f(self, *a, **k)
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._get(url).json()
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self.request(url, 'GET', **kwargs)
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:31:28.332388 dv-cinder-772623-6-iscsi neutron-server[91821]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:31:28.373013 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: d9d28434-09e7-48ed-9844-ef965b2d090b {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:31:28.373980 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device d9d28434-09e7-48ed-9844-ef965b2d090b not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:31:28.448527 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Pushing event deleted for resources: {'Port': ['ID=8262e930-0850-4885-81df-37a7db4afa6d,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:28.454717 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:28.511191 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.520236 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:28.536086 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.545015 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] Pushing event deleted for resources: {'Network': ['ID=7cbf7538-2626-435d-83dd-e10fb0c9e965,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:28.551044 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:28.571529 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73ca4fce-daa2-4855-907e-99840e6c2305 req-58860614-93b6-4f3c-87ea-dedb55fa55da tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:28.573594 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-73ca4fce-daa2-4855-907e-99840e6c2305 req-58860614-93b6-4f3c-87ea-dedb55fa55da tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1497540
May 27 09:31:28.579535 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-85d02aa6-3b67-496f-ab53-a4fc76138648 admin admin] 10.222.0.30 "DELETE /v2.0/networks/7cbf7538-2626-435d-83dd-e10fb0c9e965 HTTP/1.1" status: 204  len: 168 time: 0.8786316
May 27 09:31:28.605744 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5c059d97-8efb-4a33-b4c4-df8344435c3e req-3133e962-e551-46ad-a3d9-9d77d02f610b service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3209925
May 27 09:31:28.609208 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3811286'] for router_gateway, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.639202 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-73ca4fce-daa2-4855-907e-99840e6c2305 req-cc4a15db-e23c-4ef0-8beb-e9c5137653b3 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0556958
May 27 09:31:28.805970 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3812681', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2009'] for router, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.808558 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.834547 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52676) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:28.894920 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-97dde37f-8a4c-4048-9379-f7ae84499f2f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=0daf73d9a2424c3e9ccbe74a9d2d94f5&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0584919
May 27 09:31:28.898765 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52680) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:28.899238 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3812965'] for router, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.899943 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Fanout notify agent at l3_agent the message router_deleted on router fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 {{(pid=91820) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 27 09:31:28.916157 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Notify callbacks [] for router, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:28.917384 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] 10.222.0.30 "DELETE /v2.0/routers/fa0dd6cb-f54c-48ff-b875-5fb6d122cbe0 HTTP/1.1" status: 204  len: 168 time: 2.6577816
May 27 09:31:28.921662 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52684) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:28.988422 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-279775f8-0db5-4762-bf6c-688ac6d896af admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:29.003788 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_v2 [None req-7a3e7e88-7ea9-418d-88be-1a0fe3b0ea9c admin admin] Deleting subnet 2171d20e-0746-4ea0-9aa2-e8adfb7e51ac {{(pid=91820) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:31:29.007119 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7a3e7e88-7ea9-418d-88be-1a0fe3b0ea9c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:29.035284 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-279775f8-0db5-4762-bf6c-688ac6d896af admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:29.069285 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7a3e7e88-7ea9-418d-88be-1a0fe3b0ea9c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3483778'] for subnet, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:29.113128 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-279775f8-0db5-4762-bf6c-688ac6d896af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:29.121453 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-27df5106-a0be-4f6b-b5d7-76801be17383 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:29.136952 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-279775f8-0db5-4762-bf6c-688ac6d896af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48e9e898-8ba6-494b-b4a6-c29df60938f6,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:29.140680 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-279775f8-0db5-4762-bf6c-688ac6d896af admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:29.152218 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7a3e7e88-7ea9-418d-88be-1a0fe3b0ea9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:29.157529 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-279775f8-0db5-4762-bf6c-688ac6d896af admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:29.159921 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-279775f8-0db5-4762-bf6c-688ac6d896af admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/48e9e898-8ba6-494b-b4a6-c29df60938f6 HTTP/1.1" status: 204  len: 168 time: 0.2598367
May 27 09:31:29.446974 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7a3e7e88-7ea9-418d-88be-1a0fe3b0ea9c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2421409', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2490042'] for subnet, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:29.451206 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7abacbfe-8677-442f-92d6-6a9dffead791 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:29.668540 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a3e7e88-7ea9-418d-88be-1a0fe3b0ea9c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2171d20e-0746-4ea0-9aa2-e8adfb7e51ac,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:29.681386 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7a3e7e88-7ea9-418d-88be-1a0fe3b0ea9c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:29.685373 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7a3e7e88-7ea9-418d-88be-1a0fe3b0ea9c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:29.696765 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-7a3e7e88-7ea9-418d-88be-1a0fe3b0ea9c admin admin] 10.222.0.30 "DELETE /v2.0/subnets/2171d20e-0746-4ea0-9aa2-e8adfb7e51ac HTTP/1.1" status: 204  len: 168 time: 0.7738087
May 27 09:31:29.699509 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52702) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:29.895205 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:29.945611 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c38c3532-42f2-4856-8670-5ec2273fb90c req-d4096aaa-df0d-4aff-b6b7-4ea0039440ef tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:31:29.947115 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c38c3532-42f2-4856-8670-5ec2273fb90c req-d4096aaa-df0d-4aff-b6b7-4ea0039440ef tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.0997961
May 27 09:31:30.000196 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c38c3532-42f2-4856-8670-5ec2273fb90c req-88973f1a-82c4-4c1e-91bb-0dab3670152f tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0473182
May 27 09:31:30.046133 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:30.064907 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2ee76d36d0>,) {'filters': {'network_id': ['ca288a2a-9fc5-474b-a3f5-732ddd5ede80']}} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:30.080476 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee76d36d0>, 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54') {'for_net_delete': True} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:30.080805 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee76d36d0>, 'bd8c1b0f-c94a-4b60-a7ce-94548ae35a54') {} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:31:30.093497 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3483835'] for segment, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:30.112972 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:30.119923 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] Releasing vlan 373 on physical network physnet1 to pool {{(pid=91820) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:31:30.120322 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2421763'] for segment, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]: Traceback (most recent call last):
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     timer()
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     cb(*args, **kw)
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     return func(*args, **kwargs)
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     self._notify()
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     self.callback(batched_events)
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     event.method(event)
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     return f(self, *a, **k)
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._get(url).json()
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self.request(url, 'GET', **kwargs)
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:31:30.134895 dv-cinder-772623-6-iscsi neutron-server[91820]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:31:30.225131 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:30.234200 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:30.248725 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:30.250130 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 8262e930-0850-4885-81df-37a7db4afa6d no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:31:30.260650 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] Pushing event deleted for resources: {'Network': ['ID=ca288a2a-9fc5-474b-a3f5-732ddd5ede80,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:30.265756 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:30.272888 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-8528f967-c358-48dd-bbe0-3698fa0e66fe admin admin] 10.222.0.30 "DELETE /v2.0/networks/ca288a2a-9fc5-474b-a3f5-732ddd5ede80 HTTP/1.1" status: 204  len: 168 time: 0.5717044
May 27 09:31:30.304030 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 8262e930-0850-4885-81df-37a7db4afa6d {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:31:30.304601 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 8262e930-0850-4885-81df-37a7db4afa6d not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:31:30.556125 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52732) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:30.639965 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52738) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:30.640457 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-224844a6-8e20-448a-84b0-b525a23903a3 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=e165c54223b24166b6856b6f285c4bca&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0828431
May 27 09:31:30.711144 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7f0d403b-1ce2-4778-a651-728d4b1bd82d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:30.748323 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7f0d403b-1ce2-4778-a651-728d4b1bd82d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:30.813305 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7f0d403b-1ce2-4778-a651-728d4b1bd82d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:30.819287 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-27948280-98ff-41ea-a442-3287b825d758 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:30.839098 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f0d403b-1ce2-4778-a651-728d4b1bd82d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b092a0d-7e7a-44dd-89d6-e037e6befb57,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:30.845501 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7f0d403b-1ce2-4778-a651-728d4b1bd82d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:30.880966 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7f0d403b-1ce2-4778-a651-728d4b1bd82d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:30.885010 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-7f0d403b-1ce2-4778-a651-728d4b1bd82d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8b092a0d-7e7a-44dd-89d6-e037e6befb57 HTTP/1.1" status: 204  len: 168 time: 0.2398744
May 27 09:31:32.953185 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52820) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:33.085297 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-179fbe23-14f4-44f4-8871-9dcca95d0505 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:33.102128 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-179fbe23-14f4-44f4-8871-9dcca95d0505 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:31:33.106724 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-179fbe23-14f4-44f4-8871-9dcca95d0505 admin admin] Usage tracker for resource:security_group_rule and tenant:e70274e2db1f4547b446d5eed0d93d19 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:31:33.110132 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-179fbe23-14f4-44f4-8871-9dcca95d0505 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:31:33.119921 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-179fbe23-14f4-44f4-8871-9dcca95d0505 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:31:33.232131 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-179fbe23-14f4-44f4-8871-9dcca95d0505 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:33.236647 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-179fbe23-14f4-44f4-8871-9dcca95d0505 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:33.249658 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-f4068418-720c-4882-8cf7-b0efb17a1a0f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:33.292819 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-179fbe23-14f4-44f4-8871-9dcca95d0505 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=e70274e2db1f4547b446d5eed0d93d19&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3374846
May 27 09:31:33.294330 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-179fbe23-14f4-44f4-8871-9dcca95d0505 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7b6d1328-d222-409b-bcb5-298ef17b9bdc,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:33.295314 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52828) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:33.297372 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-179fbe23-14f4-44f4-8871-9dcca95d0505 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:33.363052 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e613dcd-b1c3-4a31-85d1-87dfc3e0e589 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:33.410985 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e613dcd-b1c3-4a31-85d1-87dfc3e0e589 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:33.474380 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e613dcd-b1c3-4a31-85d1-87dfc3e0e589 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:33.481954 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-501e851d-b5a0-46c7-ac51-be83d41eba59 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:33.507473 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e613dcd-b1c3-4a31-85d1-87dfc3e0e589 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7b6d1328-d222-409b-bcb5-298ef17b9bdc,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:33.510173 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8e613dcd-b1c3-4a31-85d1-87dfc3e0e589 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:33.511496 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e613dcd-b1c3-4a31-85d1-87dfc3e0e589 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:33.514691 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-8e613dcd-b1c3-4a31-85d1-87dfc3e0e589 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/7b6d1328-d222-409b-bcb5-298ef17b9bdc HTTP/1.1" status: 204  len: 168 time: 0.2161660
May 27 09:31:33.932492 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52844) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:33.951871 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dce24364-4f9f-41c3-bec1-10f865e720f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:33.968595 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-dce24364-4f9f-41c3-bec1-10f865e720f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:31:33.973899 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-dce24364-4f9f-41c3-bec1-10f865e720f4 admin admin] Usage tracker for resource:security_group_rule and tenant:09ba5de3f82544b2bb2b48edbd65d6de is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:31:33.977298 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-dce24364-4f9f-41c3-bec1-10f865e720f4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:31:33.984222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-dce24364-4f9f-41c3-bec1-10f865e720f4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:31:34.034322 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52848) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:34.126068 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dce24364-4f9f-41c3-bec1-10f865e720f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:34.132128 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dce24364-4f9f-41c3-bec1-10f865e720f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:34.144410 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-51dcb885-d332-4ca6-b1dc-0e8c30ab0d4b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:34.220015 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-dce24364-4f9f-41c3-bec1-10f865e720f4 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=09ba5de3f82544b2bb2b48edbd65d6de&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2856359
May 27 09:31:34.223787 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 52856) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:34.225311 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dce24364-4f9f-41c3-bec1-10f865e720f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eff4a013-9930-4622-a105-6b57fc607063,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:34.232014 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-dce24364-4f9f-41c3-bec1-10f865e720f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:34.355847 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a6a1ec88-b2f1-42de-a5ed-aa5c77b272e2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:34.400997 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5fd4f7e5-7436-48fe-ac00-980a2922ed92 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:34.449901 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5fd4f7e5-7436-48fe-ac00-980a2922ed92 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:31:34.456521 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a6a1ec88-b2f1-42de-a5ed-aa5c77b272e2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:34.478086 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5fd4f7e5-7436-48fe-ac00-980a2922ed92 admin admin] Usage tracker for resource:security_group_rule and tenant:c11a2461d746424bae66487a89d232c7 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:31:34.487101 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5fd4f7e5-7436-48fe-ac00-980a2922ed92 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:31:34.514806 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5fd4f7e5-7436-48fe-ac00-980a2922ed92 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:31:34.621099 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a6a1ec88-b2f1-42de-a5ed-aa5c77b272e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:34.627313 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-279775f8-0db5-4762-bf6c-688ac6d896af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:34.649354 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6a1ec88-b2f1-42de-a5ed-aa5c77b272e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eff4a013-9930-4622-a105-6b57fc607063,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:34.652576 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a6a1ec88-b2f1-42de-a5ed-aa5c77b272e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:34.686522 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a6a1ec88-b2f1-42de-a5ed-aa5c77b272e2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:34.688902 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-a6a1ec88-b2f1-42de-a5ed-aa5c77b272e2 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/eff4a013-9930-4622-a105-6b57fc607063 HTTP/1.1" status: 204  len: 168 time: 0.4627407
May 27 09:31:34.744856 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5fd4f7e5-7436-48fe-ac00-980a2922ed92 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:34.750117 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5fd4f7e5-7436-48fe-ac00-980a2922ed92 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:34.765733 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-fac1ec77-3994-4355-827b-9dfc200734ec admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:34.849627 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-5fd4f7e5-7436-48fe-ac00-980a2922ed92 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c11a2461d746424bae66487a89d232c7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8126655
May 27 09:31:34.850235 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fd4f7e5-7436-48fe-ac00-980a2922ed92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54e13465-93b5-44a5-8ac5-fa778c30bc5b,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:34.853301 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 52866) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:31:34.854047 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5fd4f7e5-7436-48fe-ac00-980a2922ed92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:34.963734 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1989e412-9e23-4472-bcc4-0e92ef4020e7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:35.002792 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1989e412-9e23-4472-bcc4-0e92ef4020e7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:35.080945 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1989e412-9e23-4472-bcc4-0e92ef4020e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:35.085153 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:31:35.099496 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1989e412-9e23-4472-bcc4-0e92ef4020e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54e13465-93b5-44a5-8ac5-fa778c30bc5b,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:31:35.103308 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1989e412-9e23-4472-bcc4-0e92ef4020e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:31:35.111675 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1989e412-9e23-4472-bcc4-0e92ef4020e7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:35.112729 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-1989e412-9e23-4472-bcc4-0e92ef4020e7 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/54e13465-93b5-44a5-8ac5-fa778c30bc5b HTTP/1.1" status: 204  len: 168 time: 0.2580318
May 27 09:31:38.502119 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a69efab4-7f8c-40b6-8ba0-d90866b3f807 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:41.445247 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:41.827450 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-100f493c-c024-4b41-8030-8a754c168343 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:42.355282 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:44.916629 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:31:52.093735 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:31:56.390476 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:08.501175 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-7f60dedf-b0d4-4276-abd4-835b9540b6da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:09.447436 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 53346) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:09.590938 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-677a4e6b-1c42-41c0-b728-6f328f87e44e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:09.607416 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-677a4e6b-1c42-41c0-b728-6f328f87e44e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:09.614945 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-677a4e6b-1c42-41c0-b728-6f328f87e44e admin admin] Usage tracker for resource:security_group_rule and tenant:194622c489cb48d9a2b319b1c6f3aac7 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:09.619427 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-677a4e6b-1c42-41c0-b728-6f328f87e44e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:09.629331 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-677a4e6b-1c42-41c0-b728-6f328f87e44e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:09.730090 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-677a4e6b-1c42-41c0-b728-6f328f87e44e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:09.737042 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-677a4e6b-1c42-41c0-b728-6f328f87e44e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:09.751862 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4d1e4e4f-9f1b-42fd-ad75-9d619c4bc6e0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:09.758475 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ee23e48-f96d-4bac-b469-942c9d066d44 req-ab13f2b0-aba8-488e-b5e9-2175837f830a tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:09.760100 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5ee23e48-f96d-4bac-b469-942c9d066d44 req-ab13f2b0-aba8-488e-b5e9-2175837f830a tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.3058069
May 27 09:32:09.786186 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-677a4e6b-1c42-41c0-b728-6f328f87e44e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=194622c489cb48d9a2b319b1c6f3aac7&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3372233
May 27 09:32:09.790282 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 53358) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:09.807892 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-677a4e6b-1c42-41c0-b728-6f328f87e44e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aefbbfb9-657e-432d-801c-6e2b2b8219bf,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:09.814096 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-677a4e6b-1c42-41c0-b728-6f328f87e44e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:09.838893 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5ee23e48-f96d-4bac-b469-942c9d066d44 req-db60b351-abf2-4ded-82c0-449874d50513 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0628788
May 27 09:32:09.877943 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-80a6bbe1-757d-4328-8fdc-5439b4fb4dff admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:09.915338 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-80a6bbe1-757d-4328-8fdc-5439b4fb4dff admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:09.994142 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-80a6bbe1-757d-4328-8fdc-5439b4fb4dff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:09.999218 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-9e3492d8-a169-4ed2-bff3-ac6f935b5801 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:10.014286 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80a6bbe1-757d-4328-8fdc-5439b4fb4dff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aefbbfb9-657e-432d-801c-6e2b2b8219bf,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:10.018100 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-80a6bbe1-757d-4328-8fdc-5439b4fb4dff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:10.019517 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-80a6bbe1-757d-4328-8fdc-5439b4fb4dff admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:10.023586 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-80a6bbe1-757d-4328-8fdc-5439b4fb4dff admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/aefbbfb9-657e-432d-801c-6e2b2b8219bf HTTP/1.1" status: 204  len: 168 time: 0.2294796
May 27 09:32:10.347797 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 53372) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:10.366588 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f255636e-07cf-4ebe-a22e-d6b32859f1f8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:10.384575 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-f255636e-07cf-4ebe-a22e-d6b32859f1f8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:10.389406 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-f255636e-07cf-4ebe-a22e-d6b32859f1f8 admin admin] Usage tracker for resource:security_group_rule and tenant:514d22500e934c9a83a192ed1992ed46 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:10.392942 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-f255636e-07cf-4ebe-a22e-d6b32859f1f8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:10.398763 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-f255636e-07cf-4ebe-a22e-d6b32859f1f8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:10.489233 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f255636e-07cf-4ebe-a22e-d6b32859f1f8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:10.493179 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f255636e-07cf-4ebe-a22e-d6b32859f1f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:10.502041 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-371dbd2e-4c43-4082-973b-1b2a84cdee06 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:10.542691 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-f255636e-07cf-4ebe-a22e-d6b32859f1f8 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=514d22500e934c9a83a192ed1992ed46&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1938012
May 27 09:32:10.544636 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f255636e-07cf-4ebe-a22e-d6b32859f1f8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f14fbc6-dff5-4d75-be58-409720e0d6de,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:10.545551 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 53376) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:10.548617 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f255636e-07cf-4ebe-a22e-d6b32859f1f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:10.609724 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-669c221f-6406-4e15-9d34-f32af5da3a8d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:10.636513 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-669c221f-6406-4e15-9d34-f32af5da3a8d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:10.690912 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-669c221f-6406-4e15-9d34-f32af5da3a8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:10.694687 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8f3dcde4-2c86-4db5-8896-7ba00642b020 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:10.706192 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669c221f-6406-4e15-9d34-f32af5da3a8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f14fbc6-dff5-4d75-be58-409720e0d6de,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:10.709842 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-669c221f-6406-4e15-9d34-f32af5da3a8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:10.713142 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-669c221f-6406-4e15-9d34-f32af5da3a8d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:10.714258 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-669c221f-6406-4e15-9d34-f32af5da3a8d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8f14fbc6-dff5-4d75-be58-409720e0d6de HTTP/1.1" status: 204  len: 168 time: 0.1677239
May 27 09:32:11.221926 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afe14007-1372-44e2-be59-c8af0b887b45 req-79991914-7484-468d-8dc4-41581ef6779b tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:11.223463 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-afe14007-1372-44e2-be59-c8af0b887b45 req-79991914-7484-468d-8dc4-41581ef6779b tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.2663815
May 27 09:32:11.348777 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-afe14007-1372-44e2-be59-c8af0b887b45 req-9464bf53-0f59-4b49-b297-48fa9033062f tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1193352
May 27 09:32:11.452766 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:11.821046 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-949b795b-abad-4f5d-8087-193589829c39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:12.356553 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:12.541046 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3ee2503-1b96-4171-91e8-1009263ef65e req-b316522d-7eb0-4ca7-bc12-e449d6b4ee8f tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:12.542585 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d3ee2503-1b96-4171-91e8-1009263ef65e req-b316522d-7eb0-4ca7-bc12-e449d6b4ee8f tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.0855186
May 27 09:32:12.588813 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d3ee2503-1b96-4171-91e8-1009263ef65e req-50011e4b-9f8c-4776-94da-37c5464e6860 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0396245
May 27 09:32:13.831498 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1363e64e-47c3-4fe9-8d0a-ade4adf79d4a req-813764e0-7244-4aa1-94e3-78f75cbf3fc7 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:13.836344 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1363e64e-47c3-4fe9-8d0a-ade4adf79d4a req-813764e0-7244-4aa1-94e3-78f75cbf3fc7 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.1014705
May 27 09:32:13.885457 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1363e64e-47c3-4fe9-8d0a-ade4adf79d4a req-02485295-ba7e-4797-ba88-dc52a2b53b63 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0456207
May 27 09:32:14.145472 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54eaa387-2353-4045-acdc-99c93a690e8a req-9de27e8f-5c4c-443c-89e1-9f84d742971d tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:14.146128 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-54eaa387-2353-4045-acdc-99c93a690e8a req-9de27e8f-5c4c-443c-89e1-9f84d742971d tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Synchronizing usage tracker for tenant:ea51e621877d47f29b60bce5258df734 on resource:port {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:32:14.164981 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-54eaa387-2353-4045-acdc-99c93a690e8a req-9de27e8f-5c4c-443c-89e1-9f84d742971d tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Unset dirty status for tenant:ea51e621877d47f29b60bce5258df734 on resource:port {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:32:14.166148 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-54eaa387-2353-4045-acdc-99c93a690e8a req-9de27e8f-5c4c-443c-89e1-9f84d742971d tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.11 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 946 time: 0.1133864
May 27 09:32:14.184327 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 53528) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:14.309668 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:14.310151 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-54eaa387-2353-4045-acdc-99c93a690e8a req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Deleting port 4c74ea48-9f46-439c-96c3-0cfd268e3274 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:32:14.310503 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-54eaa387-2353-4045-acdc-99c93a690e8a req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:14.325314 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:14.330369 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Usage tracker for resource:security_group_rule and tenant:95d27a8b189742b2bbec6f73009f9c7b is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:14.335744 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:14.342737 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:14.453187 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:14.458515 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:14.479351 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-54eaa387-2353-4045-acdc-99c93a690e8a req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] For port 4c74ea48-9f46-439c-96c3-0cfd268e3274, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=4c74ea48-9f46-439c-96c3-0cfd268e3274,segment=NetworkSegment(111bd85e-76cc-4ba7-8f48-b8ddd0684287),segment_id=111bd85e-76cc-4ba7-8f48-b8ddd0684287)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:14.479351 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-54eaa387-2353-4045-acdc-99c93a690e8a req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:14.479676 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-b24b80d8-16d1-422e-a0be-b5f03fbc1682 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:14.510089 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=95d27a8b189742b2bbec6f73009f9c7b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3222342
May 27 09:32:14.511573 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 53538) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:14.532499 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2ef36ad-bdb1-4b97-9fff-658393ac36e3,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:14.541205 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.541572 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.541927 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.542273 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.542617 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.542959 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.543390 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.543674 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.544037 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.544479 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.544679 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.545014 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:14.549756 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-6c9cd32c-195d-45f9-a4af-049b16c6ac7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:14.601944 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-74c1ab98-3ef8-43cf-9bf6-dd36e8ee008a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:14.611122 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-54eaa387-2353-4045-acdc-99c93a690e8a req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Calling delete_port for 4c74ea48-9f46-439c-96c3-0cfd268e3274 owned by compute:nova {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:32:14.628479 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-74c1ab98-3ef8-43cf-9bf6-dd36e8ee008a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:14.698801 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-74c1ab98-3ef8-43cf-9bf6-dd36e8ee008a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:14.704644 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ffb75d7d-9675-4138-bc5c-75ba91224a36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:14.719766 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74c1ab98-3ef8-43cf-9bf6-dd36e8ee008a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2ef36ad-bdb1-4b97-9fff-658393ac36e3,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:14.723442 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-74c1ab98-3ef8-43cf-9bf6-dd36e8ee008a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:14.724597 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-74c1ab98-3ef8-43cf-9bf6-dd36e8ee008a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:14.727971 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-74c1ab98-3ef8-43cf-9bf6-dd36e8ee008a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/f2ef36ad-bdb1-4b97-9fff-658393ac36e3 HTTP/1.1" status: 204  len: 168 time: 0.2153437
May 27 09:32:14.751674 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-54eaa387-2353-4045-acdc-99c93a690e8a req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:14.757566 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:14.766538 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['4c74ea48-9f46-439c-96c3-0cfd268e3274'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:32:14.924052 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Pushing event deleted for resources: {'Port': ['ID=4c74ea48-9f46-439c-96c3-0cfd268e3274,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:14.932354 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:14.958558 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.201s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:15.005669 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-54eaa387-2353-4045-acdc-99c93a690e8a req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] No DVR routers for this DVR port 4c74ea48-9f46-439c-96c3-0cfd268e3274 on host hv-cinder-77262 {{(pid=91820) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:32:15.008516 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-54eaa387-2353-4045-acdc-99c93a690e8a req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:15.014165 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c33bed6-7082-470c-b880-7efb7cf09e91', 'name': 'network-vif-deleted', 'tag': '4c74ea48-9f46-439c-96c3-0cfd268e3274'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:32:15.039573 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-54eaa387-2353-4045-acdc-99c93a690e8a req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.11 "DELETE /v2.0/ports/4c74ea48-9f46-439c-96c3-0cfd268e3274 HTTP/1.1" status: 204  len: 173 time: 0.8673179
May 27 09:32:15.067785 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c33bed6-7082-470c-b880-7efb7cf09e91', 'name': 'network-vif-deleted', 'tag': '4c74ea48-9f46-439c-96c3-0cfd268e3274', 'status': 'completed', 'code': 200}
May 27 09:32:15.071277 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1ecda5ea-cd6b-439c-96b3-245df0de988a req-70f588cf-75bc-4ebf-b3b0-6c5869992983 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=1c33bed6-7082-470c-b880-7efb7cf09e91 HTTP/1.1" status: 200  len: 210 time: 0.0519774
May 27 09:32:15.096564 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 53556) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:15.114251 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c6784509-85dd-408e-a190-60fd93d057d8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:15.132384 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-c6784509-85dd-408e-a190-60fd93d057d8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:15.136211 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-c6784509-85dd-408e-a190-60fd93d057d8 admin admin] Usage tracker for resource:security_group_rule and tenant:00aa0d3d244d4fa5a2afb2e0d6349346 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:15.138984 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-c6784509-85dd-408e-a190-60fd93d057d8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:15.145543 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-c6784509-85dd-408e-a190-60fd93d057d8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:15.237447 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c6784509-85dd-408e-a190-60fd93d057d8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:15.241307 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-c6784509-85dd-408e-a190-60fd93d057d8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:15.253706 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a9bcb496-54ac-46d3-a04f-ca78f962adca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:15.296009 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-c6784509-85dd-408e-a190-60fd93d057d8 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=00aa0d3d244d4fa5a2afb2e0d6349346&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1983643
May 27 09:32:15.298519 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6784509-85dd-408e-a190-60fd93d057d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d4660a9-8d99-465a-aa33-ad5e9e7d4ef6,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:15.299572 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 53560) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:15.301738 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-c6784509-85dd-408e-a190-60fd93d057d8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:15.361700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bac418fb-9cf6-416a-a0f7-d243204eac5d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:15.388896 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bac418fb-9cf6-416a-a0f7-d243204eac5d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:15.443311 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bac418fb-9cf6-416a-a0f7-d243204eac5d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:15.452292 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8afeb434-b9dc-4048-aab3-7b5140cde364 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:15.460284 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bac418fb-9cf6-416a-a0f7-d243204eac5d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d4660a9-8d99-465a-aa33-ad5e9e7d4ef6,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:15.463199 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-bac418fb-9cf6-416a-a0f7-d243204eac5d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:15.465115 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bac418fb-9cf6-416a-a0f7-d243204eac5d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:15.466214 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-bac418fb-9cf6-416a-a0f7-d243204eac5d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6d4660a9-8d99-465a-aa33-ad5e9e7d4ef6 HTTP/1.1" status: 204  len: 168 time: 0.1656418
May 27 09:32:17.792613 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 4c74ea48-9f46-439c-96c3-0cfd268e3274 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:32:17.832572 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 4c74ea48-9f46-439c-96c3-0cfd268e3274 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:32:17.832915 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 4c74ea48-9f46-439c-96c3-0cfd268e3274 not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:32:21.833026 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 53742) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:21.957328 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7ce77021-e70b-43d5-bc96-e04d1862e29b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:21.972557 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-7ce77021-e70b-43d5-bc96-e04d1862e29b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:21.976372 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-7ce77021-e70b-43d5-bc96-e04d1862e29b admin admin] Usage tracker for resource:security_group_rule and tenant:fd106666f575448a953de3f99708e8e0 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:21.979185 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-7ce77021-e70b-43d5-bc96-e04d1862e29b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:21.985720 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-7ce77021-e70b-43d5-bc96-e04d1862e29b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:22.089029 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7ce77021-e70b-43d5-bc96-e04d1862e29b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:22.094035 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7ce77021-e70b-43d5-bc96-e04d1862e29b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:22.103578 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-6e964c05-f957-4a56-8b6f-2cc52171bbab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:22.151786 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-7ce77021-e70b-43d5-bc96-e04d1862e29b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=fd106666f575448a953de3f99708e8e0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3175433
May 27 09:32:22.153587 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ce77021-e70b-43d5-bc96-e04d1862e29b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63132773-aca8-4246-8639-1bd9ad75031a,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:22.156197 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 53752) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:22.159182 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7ce77021-e70b-43d5-bc96-e04d1862e29b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:22.245961 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-86a0818a-3509-42dc-80b2-7430e23890cb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:22.288642 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-86a0818a-3509-42dc-80b2-7430e23890cb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:22.352900 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-86a0818a-3509-42dc-80b2-7430e23890cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:22.359894 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7ce77021-e70b-43d5-bc96-e04d1862e29b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:22.378547 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86a0818a-3509-42dc-80b2-7430e23890cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63132773-aca8-4246-8639-1bd9ad75031a,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:22.384235 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-86a0818a-3509-42dc-80b2-7430e23890cb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:22.395860 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-86a0818a-3509-42dc-80b2-7430e23890cb admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:22.401819 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-86a0818a-3509-42dc-80b2-7430e23890cb admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/63132773-aca8-4246-8639-1bd9ad75031a HTTP/1.1" status: 204  len: 168 time: 0.2442942
May 27 09:32:22.458690 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 53764) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:22.800797 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:22.822150 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:22.826879 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Usage tracker for resource:security_group_rule and tenant:b951f3432c0c40c5925229b037f0d167 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:22.831874 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:22.839144 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:22.904282 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 53778) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:22.923728 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7cbf5a1f-be41-4129-9792-2afadc8e69a7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:22.940855 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-7cbf5a1f-be41-4129-9792-2afadc8e69a7 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:22.945307 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-7cbf5a1f-be41-4129-9792-2afadc8e69a7 admin admin] Usage tracker for resource:security_group_rule and tenant:7d2ee060362f4a0e8c942342c8d5855c is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:22.948474 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-7cbf5a1f-be41-4129-9792-2afadc8e69a7 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:22.952424 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:22.956161 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-7cbf5a1f-be41-4129-9792-2afadc8e69a7 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:22.957796 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:22.966533 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-43b17fb2-dc47-4cb3-9539-2e5917636633 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:23.009867 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b951f3432c0c40c5925229b037f0d167&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5496154
May 27 09:32:23.010730 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c466f2d-450a-4ef4-a3c6-22a072c8fd61,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:23.012692 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 53782) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:23.019628 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.020092 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.020595 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.021065 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.021494 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.021917 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.022337 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.022765 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.023229 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.023811 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.024346 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.024697 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:23.028597 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-470b40d8-43fc-4ff2-8820-daee7b48d642 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:23.110985 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7cbf5a1f-be41-4129-9792-2afadc8e69a7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:23.119285 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7cbf5a1f-be41-4129-9792-2afadc8e69a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:23.129220 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-afaf5938-4e19-4938-93e8-46903f51ea80 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:23.179291 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6e9c19bb-cfaa-4ac5-a9c9-94d5ba942af2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:23.195175 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cbf5a1f-be41-4129-9792-2afadc8e69a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07f316bb-4ec4-4379-b08c-037cb61d50a9,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:23.198345 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7cbf5a1f-be41-4129-9792-2afadc8e69a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:23.206251 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-7cbf5a1f-be41-4129-9792-2afadc8e69a7 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=7d2ee060362f4a0e8c942342c8d5855c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2963560
May 27 09:32:23.208296 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 53786) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:23.242664 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6e9c19bb-cfaa-4ac5-a9c9-94d5ba942af2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:23.383848 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfef8719-d454-4e4f-a460-0a28bcf7ea7d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:23.432732 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfef8719-d454-4e4f-a460-0a28bcf7ea7d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:23.441999 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6e9c19bb-cfaa-4ac5-a9c9-94d5ba942af2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:23.451626 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-25cff61d-4076-465d-af31-3ef9cc1532d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:23.479701 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e9c19bb-cfaa-4ac5-a9c9-94d5ba942af2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9c466f2d-450a-4ef4-a3c6-22a072c8fd61,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:23.482038 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-6e9c19bb-cfaa-4ac5-a9c9-94d5ba942af2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:23.510176 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6e9c19bb-cfaa-4ac5-a9c9-94d5ba942af2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:23.511467 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-6e9c19bb-cfaa-4ac5-a9c9-94d5ba942af2 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9c466f2d-450a-4ef4-a3c6-22a072c8fd61 HTTP/1.1" status: 204  len: 168 time: 0.4973948
May 27 09:32:23.531339 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-262b6755-ee57-4348-a977-da6c2cd1dc5f req-e064abc7-febe-46f9-959b-6164baaf4e89 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:23.533090 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-262b6755-ee57-4348-a977-da6c2cd1dc5f req-e064abc7-febe-46f9-959b-6164baaf4e89 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 947 time: 0.1967163
May 27 09:32:23.563323 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfef8719-d454-4e4f-a460-0a28bcf7ea7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:23.569923 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-86a0818a-3509-42dc-80b2-7430e23890cb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:23.590712 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfef8719-d454-4e4f-a460-0a28bcf7ea7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07f316bb-4ec4-4379-b08c-037cb61d50a9,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:23.600883 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dfef8719-d454-4e4f-a460-0a28bcf7ea7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:23.620241 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-262b6755-ee57-4348-a977-da6c2cd1dc5f req-580998d8-b83f-4c12-b51d-ce977db85559 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0785840
May 27 09:32:23.620932 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfef8719-d454-4e4f-a460-0a28bcf7ea7d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:23.625923 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-dfef8719-d454-4e4f-a460-0a28bcf7ea7d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/07f316bb-4ec4-4379-b08c-037cb61d50a9 HTTP/1.1" status: 204  len: 168 time: 0.4184046
May 27 09:32:24.051541 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 53810) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:24.073246 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f641cbd4-f6a7-492c-a067-438a6ca70f94 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:24.090967 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-f641cbd4-f6a7-492c-a067-438a6ca70f94 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:24.095928 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-f641cbd4-f6a7-492c-a067-438a6ca70f94 admin admin] Usage tracker for resource:security_group_rule and tenant:206c814ed84347abbffb8f8f89808c2c is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:24.099515 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-f641cbd4-f6a7-492c-a067-438a6ca70f94 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:24.106881 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-f641cbd4-f6a7-492c-a067-438a6ca70f94 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:24.234552 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f641cbd4-f6a7-492c-a067-438a6ca70f94 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:24.240055 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f641cbd4-f6a7-492c-a067-438a6ca70f94 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:24.249143 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2dc3fa9a-427a-4923-9d05-b24f4b3a741a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:24.299262 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-f641cbd4-f6a7-492c-a067-438a6ca70f94 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=206c814ed84347abbffb8f8f89808c2c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2465982
May 27 09:32:24.300472 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f641cbd4-f6a7-492c-a067-438a6ca70f94 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=432cb0bc-c8a9-4f99-8d99-50071d9600d7,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:24.303156 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 53816) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:24.305691 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f641cbd4-f6a7-492c-a067-438a6ca70f94 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:24.378755 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-005d09ec-56a9-4eac-916d-524836e42125 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:24.412177 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-005d09ec-56a9-4eac-916d-524836e42125 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:24.491990 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-005d09ec-56a9-4eac-916d-524836e42125 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:24.496058 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0017aa45-5b7b-4c48-a289-a304ac8c3461 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:24.511729 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-005d09ec-56a9-4eac-916d-524836e42125 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=432cb0bc-c8a9-4f99-8d99-50071d9600d7,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:24.515593 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-005d09ec-56a9-4eac-916d-524836e42125 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:24.517979 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-005d09ec-56a9-4eac-916d-524836e42125 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:24.521568 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-005d09ec-56a9-4eac-916d-524836e42125 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/432cb0bc-c8a9-4f99-8d99-50071d9600d7 HTTP/1.1" status: 204  len: 168 time: 0.2148616
May 27 09:32:24.880364 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7293c807-0898-4092-b169-0c83f8bd8885 req-e1c8eeeb-43b6-48f1-a29b-e80dd4158aa7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:24.883002 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7293c807-0898-4092-b169-0c83f8bd8885 req-e1c8eeeb-43b6-48f1-a29b-e80dd4158aa7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 947 time: 0.1050134
May 27 09:32:24.960302 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7293c807-0898-4092-b169-0c83f8bd8885 req-e5cb3a89-5b63-4e77-861f-fc8610e19928 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0684268
May 27 09:32:26.305593 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e9c84d8-ff67-47c2-84c9-6195b08f74a5 req-dfaafa32-0364-4d5f-ae36-51abc8868a6d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:26.307466 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6e9c84d8-ff67-47c2-84c9-6195b08f74a5 req-dfaafa32-0364-4d5f-ae36-51abc8868a6d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 947 time: 0.1311061
May 27 09:32:26.366345 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6e9c84d8-ff67-47c2-84c9-6195b08f74a5 req-b467a8a5-fa5c-4be9-8798-1c5c9e0841b3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0508952
May 27 09:32:26.396183 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:26.866954 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a59c3941-bf21-43e0-ab85-da85f1e2300c req-e0f2f160-8860-4ba2-8295-11351584df54 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:26.869621 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a59c3941-bf21-43e0-ab85-da85f1e2300c req-e0f2f160-8860-4ba2-8295-11351584df54 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1114376
May 27 09:32:26.938221 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a59c3941-bf21-43e0-ab85-da85f1e2300c req-338a35be-ecb6-40d0-b8c3-05d7b3a6b556 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0534749
May 27 09:32:27.281517 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-23245d0c-9fa9-4a37-9be4-0a777947481e tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:27.283113 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-23245d0c-9fa9-4a37-9be4-0a777947481e tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/networks?id=7a08fef5-d013-4fc8-8260-e3fd96453634 HTTP/1.1" status: 200  len: 814 time: 0.1612022
May 27 09:32:27.299278 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-ba08bf23-2644-4c73-86b9-d8f81bd136bd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/quotas/ea51e621877d47f29b60bce5258df734 HTTP/1.1" status: 200  len: 375 time: 0.0106902
May 27 09:32:27.353953 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-3ea8ac51-638e-4f39-9073-2fa83831d8f1 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=ea51e621877d47f29b60bce5258df734&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0489368
May 27 09:32:27.775320 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-c2e5f531-af89-46b5-b427-d7ed9c255c08 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:27.778205 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-c2e5f531-af89-46b5-b427-d7ed9c255c08 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Synchronizing usage tracker for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:port {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:32:27.807729 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-c2e5f531-af89-46b5-b427-d7ed9c255c08 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Unset dirty status for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:port {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:32:27.810014 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-c2e5f531-af89-46b5-b427-d7ed9c255c08 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.11 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 947 time: 0.1509957
May 27 09:32:27.816131 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-354fcf7f-5d2b-4868-97c8-135219b40fad service neutron] 10.222.0.30 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4537535
May 27 09:32:27.856814 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5ec1ba6-2cba-4efa-9b2e-c9f0c7119cb3 req-ee984c7d-a99d-44d6-a41f-40236c2a959b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:27.858363 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f5ec1ba6-2cba-4efa-9b2e-c9f0c7119cb3 req-ee984c7d-a99d-44d6-a41f-40236c2a959b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 947 time: 0.3216624
May 27 09:32:28.021137 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Deleting port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:32:28.021481 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:28.092466 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f5ec1ba6-2cba-4efa-9b2e-c9f0c7119cb3 req-0ebcb68e-0b9d-4c5d-8d0f-f7e7a2c1033f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=dea06109-ed5b-4c12-9420-16f8bc9a235a&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1948054
May 27 09:32:28.101838 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-b04fff83-fb6b-477e-aa47-43ee9dc22936 service neutron] 10.222.0.30 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2794390
May 27 09:32:28.121336 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-3f0f49f1-982d-47a6-8869-f24114b1790c service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.3240271
May 27 09:32:28.215262 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] For port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:28.216226 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:28.402659 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b9a5e67f-3f1c-4389-8a2e-583051ed8afe req-178efae8-d58d-4220-b8da-8231ac42228c tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 210 time: 0.0661011
May 27 09:32:28.448316 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85de32e5-7fa5-49d8-b682-df5cf41e80c5 req-22d10e1d-9369-4cbb-acbb-5deb05245d50 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:28.450008 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85de32e5-7fa5-49d8-b682-df5cf41e80c5 req-22d10e1d-9369-4cbb-acbb-5deb05245d50 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2046816
May 27 09:32:28.531709 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85de32e5-7fa5-49d8-b682-df5cf41e80c5 req-f823c99a-d4e8-4319-be56-275673ecbb9d tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0734046
May 27 09:32:28.674465 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:28.674910 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:28.675235 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.l3_db [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Floating IP 1e925ef8-9c21-49c4-9220-1dc6bad97177 disassociated. External IP: 172.27.1.79, port: 6c2d447f-c9da-40aa-a848-6fcbf0beecb3.
May 27 09:32:28.675613 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Calling delete_port for 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 owned by compute:nova {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:32:28.825453 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:28.834878 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1c00d291-2ed9-431d-8c83-95cf7ff7724c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:28.885548 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event deleted for resources: {'Port': ['ID=6c2d447f-c9da-40aa-a848-6fcbf0beecb3,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:28.888774 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:29.095598 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:32:29.129876 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:32:29.283139 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-493dcc21-f65f-424a-86b5-9da0f0511749 req-3bf687d2-e0d1-466e-b63d-c197fe279f51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 210 time: 0.0497394
May 27 09:32:29.444775 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:32:29.457334 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d215fb2a-fdff-4217-9698-d9f3910f5138 None None] Sync routers for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:32:29.471046 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d215fb2a-fdff-4217-9698-d9f3910f5138 None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:32:29.471865 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-d215fb2a-fdff-4217-9698-d9f3910f5138 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecbbbeb0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:29.527008 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] No DVR routers for this DVR port 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 on host hv-cinder-77262 {{(pid=91820) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:32:29.529644 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:29.532995 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'name': 'network-vif-deleted', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:32:29.565203 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-1038562c-a9a8-4e0f-bc87-28ac1b7b0811 req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.11 "DELETE /v2.0/ports/6c2d447f-c9da-40aa-a848-6fcbf0beecb3 HTTP/1.1" status: 204  len: 173 time: 1.7469499
May 27 09:32:29.590854 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-43f42407-2bad-4e6c-ab12-fac8ce4ad0d0 req-b611a4bc-4ca5-40d5-9181-ab3d42b8e10f tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 210 time: 0.0470726
May 27 09:32:29.626209 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fe0e1692-d7e5-46df-b605-4c75b09216bd', 'name': 'network-vif-deleted', 'tag': '6c2d447f-c9da-40aa-a848-6fcbf0beecb3', 'status': 'completed', 'code': 200}
May 27 09:32:29.705906 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-d215fb2a-fdff-4217-9698-d9f3910f5138 None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:32:30.138821 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87130738-6cd2-4033-b9ea-a81c03f8b394 req-89dc1538-7065-4355-ac82-bd4b95426df6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:30.142198 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-87130738-6cd2-4033-b9ea-a81c03f8b394 req-89dc1538-7065-4355-ac82-bd4b95426df6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1133497
May 27 09:32:30.227168 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-87130738-6cd2-4033-b9ea-a81c03f8b394 req-e597054a-d8ed-4ebb-b957-75da46131472 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0785065
May 27 09:32:30.236905 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-d215fb2a-fdff-4217-9698-d9f3910f5138 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecbbbeb0>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:30.243239 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d215fb2a-fdff-4217-9698-d9f3910f5138 None None] Checking router: a7747f73-c1a4-4a6c-8c93-cf80d93a5583 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:32:30.253898 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d215fb2a-fdff-4217-9698-d9f3910f5138 None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:32:30.254530 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-d215fb2a-fdff-4217-9698-d9f3910f5138 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecbbbeb0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:30.477932 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-d215fb2a-fdff-4217-9698-d9f3910f5138 None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:32:30.481840 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cbef98ff-b376-4950-9475-cdd3313d94e1 req-37f59be1-625c-4f18-b565-5e0a57965acd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 210 time: 0.0450382
May 27 09:32:30.835080 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-91022fd2-ba00-4269-ad06-566520feafdf req-a30ce8db-1965-49c9-835c-8103d1ffdf63 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 210 time: 0.0770156
May 27 09:32:30.884458 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-d215fb2a-fdff-4217-9698-d9f3910f5138 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecbbbeb0>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:30.888725 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d215fb2a-fdff-4217-9698-d9f3910f5138 None None] The sync data for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi is: [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:32:31.120262 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58740ae0-316d-4d92-a12a-3ebbeefaf2b0 None None] New status for floating IP 1e925ef8-9c21-49c4-9220-1dc6bad97177: DOWN {{(pid=91823) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:32:31.440988 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-e1839c29-7640-43f1-8dc4-174c7812865f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:31.446979 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-e1839c29-7640-43f1-8dc4-174c7812865f service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a31154df1ce4420f9bdf53b8b3b3649e&device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 1098 time: 0.1901786
May 27 09:32:31.493224 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd5fa950-c670-4e3b-a280-901ece5d53bb req-ef378cf7-0ff1-4d7d-8e4c-b6c4af4a6ed2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:31.495756 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fd5fa950-c670-4e3b-a280-901ece5d53bb req-ef378cf7-0ff1-4d7d-8e4c-b6c4af4a6ed2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.1370058
May 27 09:32:31.623017 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fd5fa950-c670-4e3b-a280-901ece5d53bb req-1789409d-4703-47d1-be18-4e08ff4aab40 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1185513
May 27 09:32:31.707766 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-d42ce46d-cb69-4b87-beeb-eef77b3e024e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:31.709356 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-d42ce46d-cb69-4b87-beeb-eef77b3e024e service neutron] 10.222.0.11 "GET /v2.0/networks?id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba HTTP/1.1" status: 200  len: 909 time: 0.2316108
May 27 09:32:31.929469 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-7aa127d8-47eb-46b7-aac0-6a12cd1f3b6d service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d HTTP/1.1" status: 200  len: 1000 time: 0.2094622
May 27 09:32:31.943205 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-735781a8-79ad-46ab-98df-c2e7528683b6 req-a6cd55e6-7374-406c-a060-181dda578d7a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=fe0e1692-d7e5-46df-b605-4c75b09216bd HTTP/1.1" status: 200  len: 210 time: 0.1408734
May 27 09:32:32.003457 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a53e213-9991-44a1-8269-0262f76e9286 req-de1f0751-dc24-4236-b5c4-52f929f9daa2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:32.006860 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4a53e213-9991-44a1-8269-0262f76e9286 req-de1f0751-dc24-4236-b5c4-52f929f9daa2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.11 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.2498608
May 27 09:32:32.115112 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-fd7bbc3f-b078-43ba-bc33-40dcc409f897 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:32.125068 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-fd7bbc3f-b078-43ba-bc33-40dcc409f897 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6659533b-b3b0-4d3c-8bf0-709a19b7728d HTTP/1.1" status: 200  len: 847 time: 0.1826339
May 27 09:32:32.160893 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6cd32de6-6b8c-425c-9f96-a518193e1e0b req-6691110a-e191-4ecf-a8ea-441921b4609e tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 210 time: 0.0906003
May 27 09:32:32.167604 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54002) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:32.309565 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-fc435302-be4d-4556-b385-47c7acffd664 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:32.311143 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-fc435302-be4d-4556-b385-47c7acffd664 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1838520
May 27 09:32:32.373299 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Deleting port 5c6508e0-a5e3-49f0-adc0-fd87845be346 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:32:32.373456 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:32.418456 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7195f43c-b23d-407b-ba75-437ab70b7956 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:32.510843 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-7195f43c-b23d-407b-ba75-437ab70b7956 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:32.516857 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-7195f43c-b23d-407b-ba75-437ab70b7956 admin admin] Usage tracker for resource:security_group_rule and tenant:7ee7ebe7f113415c981131ef5d20125f is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:32.525649 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-7195f43c-b23d-407b-ba75-437ab70b7956 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:32.545040 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-7195f43c-b23d-407b-ba75-437ab70b7956 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:32.612211 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-02109f8e-d0cf-4eb6-af06-0b26401d96ed service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2937479
May 27 09:32:32.648833 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] For port 5c6508e0-a5e3-49f0-adc0-fd87845be346, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=5c6508e0-a5e3-49f0-adc0-fd87845be346,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:32.649547 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:32.672726 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-69e60d0d-cfd9-4b06-a5ea-675f0d98472f tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:32.674598 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-69e60d0d-cfd9-4b06-a5ea-675f0d98472f tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.11 "GET /v2.0/networks?id=7a08fef5-d013-4fc8-8260-e3fd96453634 HTTP/1.1" status: 200  len: 814 time: 0.2499180
May 27 09:32:32.741034 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Request body: {'port': {'device_id': '7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da', 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634', 'admin_state_up': True, 'tenant_id': 'ea51e621877d47f29b60bce5258df734'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:32.917065 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3638283e-47cd-4c06-8251-03cea3116ea8 req-d7bf36e2-4101-495c-93db-2c99eee25403 service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2901556
May 27 09:32:32.948964 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:32.958683 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Usage tracker for resource:port and tenant:ea51e621877d47f29b60bce5258df734 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:32.964111 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:32.973837 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:32.991555 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Made reservation on behalf of ea51e621877d47f29b60bce5258df734 for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:32:32.995662 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.190535 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54044) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:33.200992 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7195f43c-b23d-407b-ba75-437ab70b7956 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.228360 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7195f43c-b23d-407b-ba75-437ab70b7956 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.249516 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-2e72e42f-9233-4522-9f7f-91fb5bd1327f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:33.266166 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Allocated IP 172.20.0.9 (7a08fef5-d013-4fc8-8260-e3fd96453634/b5e42a76-0f30-4445-a1f6-5d4cc78bf42c/07dac26a-791f-4736-a4b5-e13624421946) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:32:33.386306 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fea5a0d-1527-413b-bbce-eab541bcc54e req-7700a47e-9307-42be-952d-192e43e0b816 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:33.391948 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9fea5a0d-1527-413b-bbce-eab541bcc54e req-7700a47e-9307-42be-952d-192e43e0b816 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 945 time: 0.5980885
May 27 09:32:33.452900 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9eadd2bd-af01-4fa0-a8b8-bc41243fcdc3 req-96d155a7-5502-40d8-ae77-dbc13797538c tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 210 time: 0.1168036
May 27 09:32:33.460256 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-7195f43c-b23d-407b-ba75-437ab70b7956 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=7ee7ebe7f113415c981131ef5d20125f&name=default HTTP/1.1" status: 200  len: 2979 time: 1.2886028
May 27 09:32:33.469271 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54052) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:33.491525 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.492158 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.492695 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.l3_db [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Floating IP 5fc6be98-ec41-4ce6-951b-e30316534b68 disassociated. External IP: 172.27.1.118, port: 5c6508e0-a5e3-49f0-adc0-fd87845be346.
May 27 09:32:33.493294 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Calling delete_port for 5c6508e0-a5e3-49f0-adc0-fd87845be346 owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:32:33.495999 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b257f582-a0d4-4b6c-960a-dfb56ed78f1a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.507884 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7195f43c-b23d-407b-ba75-437ab70b7956 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2d7a673-1c24-4179-b163-82ff2d038feb,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:33.522567 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7195f43c-b23d-407b-ba75-437ab70b7956 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:33.561010 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9fea5a0d-1527-413b-bbce-eab541bcc54e req-0e18837a-15d6-4192-80a2-c4ebb310ca05 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1408005
May 27 09:32:33.691688 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.693883 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b257f582-a0d4-4b6c-960a-dfb56ed78f1a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.699420 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-6b386254-79df-488a-a777-789c711685b4 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:33.745949 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event deleted for resources: {'Port': ['ID=5c6508e0-a5e3-49f0-adc0-fd87845be346,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:33.749018 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:33.768271 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-686d290e-2a5c-4919-8532-d72e1bbc5a98 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.818954 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.832556 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-686d290e-2a5c-4919-8532-d72e1bbc5a98 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.849823 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b257f582-a0d4-4b6c-960a-dfb56ed78f1a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.861728 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-dce24364-4f9f-41c3-bec1-10f865e720f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:33.889390 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b257f582-a0d4-4b6c-960a-dfb56ed78f1a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=dea06109-ed5b-4c12-9420-16f8bc9a235a,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:33.901669 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b257f582-a0d4-4b6c-960a-dfb56ed78f1a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:33.938961 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.941462 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b257f582-a0d4-4b6c-960a-dfb56ed78f1a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:33.942622 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-b257f582-a0d4-4b6c-960a-dfb56ed78f1a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "DELETE /v2.0/security-groups/dea06109-ed5b-4c12-9420-16f8bc9a235a HTTP/1.1" status: 204  len: 168 time: 0.7509396
May 27 09:32:33.947990 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:33.953130 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54056) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:33.978299 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.api.v2.resource [None req-4f443568-c08f-4b3e-9138-6faa9d72a96b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] show failed (client error): The resource could not be found.
May 27 09:32:33.980310 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-4f443568-c08f-4b3e-9138-6faa9d72a96b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups/dea06109-ed5b-4c12-9420-16f8bc9a235a HTTP/1.1" status: 404  len: 347 time: 0.0255752
May 27 09:32:33.981746 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Router ad64253e-1ce7-4c03-90db-1073e41e8e5f has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:32:33.986595 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54060) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:34.005909 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-686d290e-2a5c-4919-8532-d72e1bbc5a98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:34.027897 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-686d290e-2a5c-4919-8532-d72e1bbc5a98 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:34.028950 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-686d290e-2a5c-4919-8532-d72e1bbc5a98 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c2d7a673-1c24-4179-b163-82ff2d038feb HTTP/1.1" status: 204  len: 168 time: 0.5564075
May 27 09:32:34.035288 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Network 7a08fef5-d013-4fc8-8260-e3fd96453634 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:32:34.039049 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:32:34.041107 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Pushing event updated for resources: {'Port': ['ID=07dac26a-791f-4736-a4b5-e13624421946,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:34.043355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:32:34.074832 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:34.075544 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b71e44b3-5c2e-41eb-b708-c19fee1ec99a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.062s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:34.100428 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-686d290e-2a5c-4919-8532-d72e1bbc5a98 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2d7a673-1c24-4179-b163-82ff2d038feb,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:34.104973 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-686d290e-2a5c-4919-8532-d72e1bbc5a98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:34.134132 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:34.135785 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:34.161891 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-071cede9-a096-461f-a167-8b3fd0d314c4 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.4250450
May 27 09:32:34.176684 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Request body: {'port': {'device_id': '7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:34.323869 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:34.494120 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:32:34.494637 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54074) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:34.513385 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fed023b-146e-4b92-8fa6-215f9da02f3f None None] Sync routers for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:32:34.528879 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a050ae8-0b8c-42af-bcee-bf494a13d15e admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:34.531234 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fed023b-146e-4b92-8fa6-215f9da02f3f None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:32:34.532224 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-0fed023b-146e-4b92-8fa6-215f9da02f3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecdea0a0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:34.559410 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-6a050ae8-0b8c-42af-bcee-bf494a13d15e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:34.569439 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-6a050ae8-0b8c-42af-bcee-bf494a13d15e admin admin] Usage tracker for resource:security_group_rule and tenant:9974d0d98d4545818ac389c329fddeb4 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:34.590170 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-6a050ae8-0b8c-42af-bcee-bf494a13d15e admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:34.607041 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-6a050ae8-0b8c-42af-bcee-bf494a13d15e admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:34.667966 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] No DVR routers for this DVR port 5c6508e0-a5e3-49f0-adc0-fd87845be346 on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:32:34.679636 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:34.682739 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b428e51d-c310-481e-9c08-42415117a7a3', 'name': 'network-vif-deleted', 'tag': '5c6508e0-a5e3-49f0-adc0-fd87845be346'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:32:34.702886 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4a53e213-9991-44a1-8269-0262f76e9286 req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.11 "DELETE /v2.0/ports/5c6508e0-a5e3-49f0-adc0-fd87845be346 HTTP/1.1" status: 204  len: 173 time: 2.6902144
May 27 09:32:34.714824 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Deleting port 35b194f3-33d3-4bb0-8ff6-6d7b89f64157 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:32:34.715477 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:34.878125 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-0fed023b-146e-4b92-8fa6-215f9da02f3f None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:32:34.978143 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a050ae8-0b8c-42af-bcee-bf494a13d15e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:34.988206 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 07dac26a-791f-4736-a4b5-e13624421946 {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:32:34.994556 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6a050ae8-0b8c-42af-bcee-bf494a13d15e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.011142 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e7b4702f-c83f-4179-b4bb-a540079de4b6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:35.046927 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.081805 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a050ae8-0b8c-42af-bcee-bf494a13d15e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=554ad53e-798d-46b0-a837-32f7ae3d0e22,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:35.086041 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6a050ae8-0b8c-42af-bcee-bf494a13d15e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:35.102001 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Transition to ACTIVE for port object 07dac26a-791f-4736-a4b5-e13624421946 will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:35.111491 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-6a050ae8-0b8c-42af-bcee-bf494a13d15e admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9974d0d98d4545818ac389c329fddeb4&name=default HTTP/1.1" status: 200  len: 2979 time: 0.6164753
May 27 09:32:35.111827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54084) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:35.113720 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.118875 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b90ac01a-f5d7-4ad5-b805-705f07e45b17 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:35.128078 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-fff3950f-56fc-473b-8a6e-285d20865f2c req-bb2da15f-605d-45f1-aa8c-1f3ed68bcf79 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Synchronizing usage tracker for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:32:35.229704 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-fff3950f-56fc-473b-8a6e-285d20865f2c req-bb2da15f-605d-45f1-aa8c-1f3ed68bcf79 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Unset dirty status for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:32:35.230951 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fff3950f-56fc-473b-8a6e-285d20865f2c req-bb2da15f-605d-45f1-aa8c-1f3ed68bcf79 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=b428e51d-c310-481e-9c08-42415117a7a3 HTTP/1.1" status: 200  len: 210 time: 0.3319881
May 27 09:32:35.233592 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.234667 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.260073 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 5c6508e0-a5e3-49f0-adc0-fd87845be346 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:32:35.303561 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 5c6508e0-a5e3-49f0-adc0-fd87845be346 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:32:35.304433 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 5c6508e0-a5e3-49f0-adc0-fd87845be346 not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:32:35.305428 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:32:35.367005 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Pushing event updated for resources: {'Port': ['ID=07dac26a-791f-4736-a4b5-e13624421946,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:35.377350 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:35.407123 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:32:35.407804 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 6c2d447f-c9da-40aa-a848-6fcbf0beecb3 not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:32:35.448605 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-0fed023b-146e-4b92-8fa6-215f9da02f3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecdea0a0>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:35.458500 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fed023b-146e-4b92-8fa6-215f9da02f3f None None] Checking router: ad64253e-1ce7-4c03-90db-1073e41e8e5f for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:32:35.480044 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fed023b-146e-4b92-8fa6-215f9da02f3f None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:32:35.481903 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-0fed023b-146e-4b92-8fa6-215f9da02f3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecdea0a0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:35.487787 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Calling delete_port for 35b194f3-33d3-4bb0-8ff6-6d7b89f64157 owned by network:floatingip {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:32:35.520499 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b35d45f-8826-4412-a14e-f53a8c0348f3 req-50e0c4e8-2947-43c2-83c5-51a721bac94b tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:35.522071 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b35d45f-8826-4412-a14e-f53a8c0348f3 req-50e0c4e8-2947-43c2-83c5-51a721bac94b tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 931 time: 0.6597943
May 27 09:32:35.528092 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-be7fbe4d-e06f-4724-9253-7a3780f64f13 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.537563 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Attempting to bind port 07dac26a-791f-4736-a4b5-e13624421946 on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:32:35.538287 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Attempting to bind port 07dac26a-791f-4736-a4b5-e13624421946 by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '111bd85e-76cc-4ba7-8f48-b8ddd0684287', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:32:35.538797 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Attempting to bind port 07dac26a-791f-4736-a4b5-e13624421946 on network 7a08fef5-d013-4fc8-8260-e3fd96453634 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:32:35.552982 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Port 07dac26a-791f-4736-a4b5-e13624421946 on network 7a08fef5-d013-4fc8-8260-e3fd96453634 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:32:35.553562 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Attempting to bind port 07dac26a-791f-4736-a4b5-e13624421946 on network 7a08fef5-d013-4fc8-8260-e3fd96453634 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:32:35.566789 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 32, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:32:35.567616 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Checking segment: {'id': '111bd85e-76cc-4ba7-8f48-b8ddd0684287', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:32:35.570085 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Bound using segment: {'id': '111bd85e-76cc-4ba7-8f48-b8ddd0684287', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:32:35.570779 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Bound port: 07dac26a-791f-4736-a4b5-e13624421946, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '111bd85e-76cc-4ba7-8f48-b8ddd0684287', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 363, 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:32:35.572134 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.634497 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-be7fbe4d-e06f-4724-9253-7a3780f64f13 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.681198 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b35d45f-8826-4412-a14e-f53a8c0348f3 req-9f4a0a76-278d-4290-b3cc-c8be3ab3f599 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1410313
May 27 09:32:35.782310 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b428e51d-c310-481e-9c08-42415117a7a3', 'name': 'network-vif-deleted', 'tag': '5c6508e0-a5e3-49f0-adc0-fd87845be346', 'status': 'completed', 'code': 200}
May 27 09:32:35.809802 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.814794 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:35.832895 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] For port 07dac26a-791f-4736-a4b5-e13624421946, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:32:35.839709 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] For port 07dac26a-791f-4736-a4b5-e13624421946, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=07dac26a-791f-4736-a4b5-e13624421946,segment=NetworkSegment(111bd85e-76cc-4ba7-8f48-b8ddd0684287),segment_id=111bd85e-76cc-4ba7-8f48-b8ddd0684287)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:32:35.846702 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.852761 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-be7fbe4d-e06f-4724-9253-7a3780f64f13 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.857198 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-83b3ba21-2242-4a2e-a1f3-0f4c84a97d51 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:35.869501 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event deleted for resources: {'Port': ['ID=35b194f3-33d3-4bb0-8ff6-6d7b89f64157,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:35.876465 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:35.876986 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5fd4f7e5-7436-48fe-ac00-980a2922ed92 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.011s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:35.898669 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-0fed023b-146e-4b92-8fa6-215f9da02f3f None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:32:35.929581 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7fbe4d-e06f-4724-9253-7a3780f64f13 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=554ad53e-798d-46b0-a837-32f7ae3d0e22,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:35.937731 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:35.938605 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:35.940670 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] 10.222.0.11 "PUT /v2.0/ports/07dac26a-791f-4736-a4b5-e13624421946 HTTP/1.1" status: 200  len: 1093 time: 1.7695909
May 27 09:32:35.941213 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da', 'tag': '07dac26a-791f-4736-a4b5-e13624421946'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:32:35.968787 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-be7fbe4d-e06f-4724-9253-7a3780f64f13 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:35.992111 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Pushing event updated for resources: {'Port': ['ID=07dac26a-791f-4736-a4b5-e13624421946,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:35.999688 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:36.003505 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-be7fbe4d-e06f-4724-9253-7a3780f64f13 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:36.004880 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-be7fbe4d-e06f-4724-9253-7a3780f64f13 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/554ad53e-798d-46b0-a837-32f7ae3d0e22 HTTP/1.1" status: 204  len: 168 time: 0.8880062
May 27 09:32:36.012863 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:36.013156 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da', 'tag': '07dac26a-791f-4736-a4b5-e13624421946', 'status': 'completed', 'code': 200}
May 27 09:32:36.016549 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:36.017791 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "DELETE /v2.0/floatingips/1e925ef8-9c21-49c4-9220-1dc6bad97177 HTTP/1.1" status: 204  len: 168 time: 2.0302162
May 27 09:32:36.242669 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-808e9883-25b4-4471-bb5e-140ab4bae231 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:36.244252 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-808e9883-25b4-4471-bb5e-140ab4bae231 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=ea51e621877d47f29b60bce5258df734&device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 1096 time: 0.1703312
May 27 09:32:36.411732 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-82f7eb4c-ff94-42be-ae13-232d91a59f38 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=07dac26a-791f-4736-a4b5-e13624421946 HTTP/1.1" status: 200  len: 217 time: 0.1593375
May 27 09:32:36.447717 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54108) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:36.476986 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54112) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:36.493097 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'security_group': {'name': 'tempest-securitygroup--471285243', 'description': 'tempest-description--377171864'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:36.503911 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:36.517324 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Usage tracker for resource:security_group and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:36.518656 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-25267a1c-f3f2-44a8-b6e9-f000d5965bba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:36.520371 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-25267a1c-f3f2-44a8-b6e9-f000d5965bba service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b5e42a76-0f30-4445-a1f6-5d4cc78bf42c HTTP/1.1" status: 200  len: 854 time: 0.1006780
May 27 09:32:36.522776 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:36.542475 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:36.590291 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:36.600355 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54116) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:36.618093 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ee064234-bdaa-4a09-9484-fc3bd85c50f6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:36.622891 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-4e50545c-90e5-4cec-827e-d09a79d1ab70 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7a08fef5-d013-4fc8-8260-e3fd96453634&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0942936
May 27 09:32:36.634569 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:36.644117 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Usage tracker for resource:security_group_rule and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:36.653901 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:36.667045 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:36.670345 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ee064234-bdaa-4a09-9484-fc3bd85c50f6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:36.776008 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-0fed023b-146e-4b92-8fa6-215f9da02f3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecdea0a0>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:36.792497 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0fed023b-146e-4b92-8fa6-215f9da02f3f None None] The sync data for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi is: [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:32:36.830939 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ee064234-bdaa-4a09-9484-fc3bd85c50f6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:36.840575 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:36.847567 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-6e9c19bb-cfaa-4ac5-a9c9-94d5ba942af2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:36.874592 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:36.882751 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee064234-bdaa-4a09-9484-fc3bd85c50f6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:36.906474 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ee064234-bdaa-4a09-9484-fc3bd85c50f6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:36.911264 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-3bed3d94-647e-4b1d-b728-97d65a292b71 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.029s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:37.012139 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.017077 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1778 time: 0.5248563
May 27 09:32:37.017887 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54132) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:37.020949 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3f0ac278-1f4e-4d87-8834-49432888ad4c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.029979 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'security_group_rule': {'security_group_id': '3f848da4-f4c2-436d-acc8-dc0cd5d695b1', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:37.030517 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ee064234-bdaa-4a09-9484-fc3bd85c50f6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.034536 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-ee064234-bdaa-4a09-9484-fc3bd85c50f6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "DELETE /v2.0/security-groups/a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b HTTP/1.1" status: 204  len: 168 time: 0.5831850
May 27 09:32:37.034536 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3f848da4-f4c2-436d-acc8-dc0cd5d695b1,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:37.035762 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54136) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:37.044036 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:37.052848 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-3f0ac278-1f4e-4d87-8834-49432888ad4c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:37.065377 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:37.066093 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-3f0ac278-1f4e-4d87-8834-49432888ad4c admin admin] Usage tracker for resource:security_group_rule and tenant:de26b558d8ff442794c3d33e9bc3b5af is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:37.070193 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-3f0ac278-1f4e-4d87-8834-49432888ad4c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:37.079158 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-3f0ac278-1f4e-4d87-8834-49432888ad4c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:37.085532 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Usage tracker for resource:security_group_rule and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:37.092096 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:37.108216 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.api.v2.resource [None req-30e84908-711b-4c69-8f9f-fc93230179fa tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] show failed (client error): The resource could not be found.
May 27 09:32:37.113370 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-30e84908-711b-4c69-8f9f-fc93230179fa tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups/a26a0f8a-4fd4-4301-b3a1-57d5e3d2192b HTTP/1.1" status: 404  len: 347 time: 0.0616062
May 27 09:32:37.113639 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54142) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:37.114329 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:37.124332 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-88e6b107-ee0e-4010-9a89-1936a604a458 service neutron] 10.222.0.11 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4942136
May 27 09:32:37.190327 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab55f6b3-e7ef-4cf9-91ac-27271c53679f req-451d56ec-29f3-4d75-bf98-bf40115fb2da tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:37.191960 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ab55f6b3-e7ef-4cf9-91ac-27271c53679f req-451d56ec-29f3-4d75-bf98-bf40115fb2da tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 943 time: 0.2222600
May 27 09:32:37.244222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.320102 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ac91bc5-a6ab-4048-a7fe-67346135179e None None] New status for floating IP 5fc6be98-ec41-4ce6-951b-e30316534b68: DOWN {{(pid=91823) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:32:37.337599 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d7979a72-0538-422a-8c33-d2cbe8fc7508 req-750a6466-f3e4-49b4-aa52-63351c29d089 service neutron] 10.222.0.11 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2051699
May 27 09:32:37.432741 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ab55f6b3-e7ef-4cf9-91ac-27271c53679f req-5092fef0-cd3c-4605-ae86-482ad159ca82 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2295609
May 27 09:32:37.501763 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.510496 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.515534 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:37.522623 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3f0ac278-1f4e-4d87-8834-49432888ad4c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.544798 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-3f0ac278-1f4e-4d87-8834-49432888ad4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.554484 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=68b5988c-16a9-4bb3-a27e-0f88628f7eab,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:37.565116 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:37.579714 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.581472 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-46b6234d-a22e-44e5-9bbb-138e64745ddf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.5628467
May 27 09:32:37.586032 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54154) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:37.592327 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'security_group_rule': {'security_group_id': '3f848da4-f4c2-436d-acc8-dc0cd5d695b1', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:37.599188 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7195f43c-b23d-407b-ba75-437ab70b7956 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:37.606831 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:37.615279 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Usage tracker for resource:security_group_rule and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:37.616119 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Deleting port 76c69881-aefd-4a3c-bc28-adbfe8bab0a8 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:32:37.616474 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.620178 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81bc229e-ad04-49b1-b47a-908b066e078c req-09d2dda9-719e-40be-aba6-ea1eda6cefd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:37.621808 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-81bc229e-ad04-49b1-b47a-908b066e078c req-09d2dda9-719e-40be-aba6-ea1eda6cefd0 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=ea51e621877d47f29b60bce5258df734&device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 1096 time: 0.2106423
May 27 09:32:37.626722 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:37.657681 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:37.666729 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-3f0ac278-1f4e-4d87-8834-49432888ad4c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=de26b558d8ff442794c3d33e9bc3b5af&name=default HTTP/1.1" status: 200  len: 2979 time: 1.0623994
May 27 09:32:37.717113 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54158) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:37.725045 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f0ac278-1f4e-4d87-8834-49432888ad4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ecde8e7c-6378-4b94-b850-e5de52eef09f,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:37.745094 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-3f0ac278-1f4e-4d87-8834-49432888ad4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:37.785097 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.833302 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.833644 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.858268 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f2eb5ac8-a7d8-4f7f-9048-bbebbe910438 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.867053 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81bc229e-ad04-49b1-b47a-908b066e078c req-f25d321c-2ef2-4a89-a0dd-8351d2fab300 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:37.868915 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-81bc229e-ad04-49b1-b47a-908b066e078c req-f25d321c-2ef2-4a89-a0dd-8351d2fab300 service neutron] 10.222.0.11 "GET /v2.0/networks?id=7a08fef5-d013-4fc8-8260-e3fd96453634 HTTP/1.1" status: 200  len: 915 time: 0.2385440
May 27 09:32:37.960716 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.962902 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-81bc229e-ad04-49b1-b47a-908b066e078c req-d67e1b34-63f5-415e-a1a6-b27af7a5b872 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=07dac26a-791f-4736-a4b5-e13624421946 HTTP/1.1" status: 200  len: 217 time: 0.0858526
May 27 09:32:37.966689 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:37.969864 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1934f1f0-4983-41bb-a50a-5bd72f3341f6 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:37.993473 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Calling delete_port for 76c69881-aefd-4a3c-bc28-adbfe8bab0a8 owned by network:floatingip {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:32:38.015621 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f2eb5ac8-a7d8-4f7f-9048-bbebbe910438 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:38.035664 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=46cbcc3f-0058-415a-aaa5-805d97dd20cb,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:38.049166 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:38.065057 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:38.066269 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-ac05c9bd-cd8f-4dcb-a20d-2d2c59f8f8dd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4794631
May 27 09:32:38.069473 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54168) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:38.077890 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'floatingip': {'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:38.086049 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81bc229e-ad04-49b1-b47a-908b066e078c req-3eb927a3-cddc-49bc-a5e6-953d44b0ea64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:38.087636 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-81bc229e-ad04-49b1-b47a-908b066e078c req-3eb927a3-cddc-49bc-a5e6-953d44b0ea64 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b5e42a76-0f30-4445-a1f6-5d4cc78bf42c HTTP/1.1" status: 200  len: 854 time: 0.1108024
May 27 09:32:38.088720 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:38.094339 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Usage tracker for resource:floatingip and tenant:f631f0ceb250483891019fb79b2e6b83 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:38.099768 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:38.148036 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:38.158391 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-81bc229e-ad04-49b1-b47a-908b066e078c req-9fd1f42f-9d94-433b-974a-c6cc8b9a1c05 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=7a08fef5-d013-4fc8-8260-e3fd96453634&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0600231
May 27 09:32:38.201123 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f2eb5ac8-a7d8-4f7f-9048-bbebbe910438 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:38.202823 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:38.247901 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-d0435a63-4424-4080-9fe5-24c5b277bba1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:38.276352 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2eb5ac8-a7d8-4f7f-9048-bbebbe910438 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ecde8e7c-6378-4b94-b850-e5de52eef09f,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:38.286749 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-f2eb5ac8-a7d8-4f7f-9048-bbebbe910438 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:38.309870 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f2eb5ac8-a7d8-4f7f-9048-bbebbe910438 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:38.315005 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-f2eb5ac8-a7d8-4f7f-9048-bbebbe910438 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ecde8e7c-6378-4b94-b850-e5de52eef09f HTTP/1.1" status: 204  len: 168 time: 0.5928335
May 27 09:32:38.317365 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:38.325529 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0c8fd91f-e2dd-4a9c-9ae3-6f2a0f341ea3 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:38.378037 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event deleted for resources: {'Port': ['ID=76c69881-aefd-4a3c-bc28-adbfe8bab0a8,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:38.417009 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:38.422189 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-81bc229e-ad04-49b1-b47a-908b066e078c req-6cf7d263-9045-45f9-a351-5e61193f4831 service neutron] 10.222.0.11 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2565207
May 27 09:32:38.486283 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:38.489850 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:38.491401 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "DELETE /v2.0/floatingips/5fc6be98-ec41-4ce6-951b-e30316534b68 HTTP/1.1" status: 204  len: 168 time: 1.3768606
May 27 09:32:38.532322 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5437d7f1-0c57-4cfc-a3f9-cf421e369201 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:38.639154 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:38.688925 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-81bc229e-ad04-49b1-b47a-908b066e078c req-ec5edc71-9871-4f4f-a3e6-7424b28177f4 service neutron] 10.222.0.11 "GET /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2593262
May 27 09:32:38.753119 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ff4ac69-374f-41bf-bf65-3f65c0218d48 req-0b717706-4f26-4db4-9a56-6338e0a1b9d2 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:38.769151 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ff4ac69-374f-41bf-bf65-3f65c0218d48 req-0b717706-4f26-4db4-9a56-6338e0a1b9d2 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 943 time: 0.1622066
May 27 09:32:38.839869 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Allocated IP 172.27.1.74 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/1eca5e85-1780-4a06-acb9-4adebee714f4) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:32:38.869118 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ff4ac69-374f-41bf-bf65-3f65c0218d48 req-e20bc539-8d71-4fec-b01a-1263706ca299 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0988941
May 27 09:32:39.032058 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.096725 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.103722 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:39.180193 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:32:39.185394 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:32:39.193055 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:32:39.269572 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'Port': ['ID=1eca5e85-1780-4a06-acb9-4adebee714f4,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:39.274007 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:39.328487 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54218) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:39.335976 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.338735 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1038474192', 'description': 'tempest-description--1486027462'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:39.352143 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:39.357765 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Usage tracker for resource:security_group and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:39.361678 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:39.369934 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:39.384458 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.416638 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:39.423405 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Usage tracker for resource:security_group_rule and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:39.427250 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:39.434775 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:39.537763 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.542141 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.543942 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.554257 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-74c1ab98-3ef8-43cf-9bf6-dd36e8ee008a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:39.623526 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'SecurityGroup': ['ID=678d7678-18e3-4d7c-aecd-a992255c87ef,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:39.628442 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.629595 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1780 time: 0.2996881
May 27 09:32:39.640380 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54232) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:39.641849 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:39.647570 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'security_group_rule': {'security_group_id': '678d7678-18e3-4d7c-aecd-a992255c87ef', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:39.654325 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:39.659593 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Usage tracker for resource:security_group_rule and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:39.662819 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:39.669353 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:39.690545 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.771024 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.773515 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.777587 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:39.846624 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6640040b-c19b-44d7-a310-31065546b336,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:39.853419 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:39.855517 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.862119 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-dd6a549c-0e1e-447b-9dac-0f3d26c09db1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.2188795
May 27 09:32:39.863090 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54242) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:39.875905 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'security_group_rule': {'security_group_id': '678d7678-18e3-4d7c-aecd-a992255c87ef', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:39.881155 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.891935 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.894106 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:39.901636 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Usage tracker for resource:security_group_rule and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:39.909530 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:39.915111 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:39.924603 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:39.977652 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:39.997047 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'Port': ['ID=1eca5e85-1780-4a06-acb9-4adebee714f4,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:40.026888 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:40.103241 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:40.110075 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:40.112567 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:40.118249 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:40.133366 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=03437029-c52c-439e-bc4b-f80fb37c57ad,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:40.174536 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:40.198022 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:40.201190 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 692 time: 2.1303101
May 27 09:32:40.218037 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:40.219452 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.3546889
May 27 09:32:40.224615 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54254) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:40.232398 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'floatingip': {'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:40.241725 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:40.249540 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Usage tracker for resource:floatingip and tenant:3b2fb81840c64238b0ae0db08ca9b139 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:40.254097 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:40.266455 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:40.282559 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:40.329322 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9065f8a-f6a5-4196-8b54-479041696d92 req-6151b17b-5a3c-45c5-9788-5aae0c7123ee tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:40.331182 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d9065f8a-f6a5-4196-8b54-479041696d92 req-6151b17b-5a3c-45c5-9788-5aae0c7123ee tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 943 time: 0.2031682
May 27 09:32:40.529890 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d9065f8a-f6a5-4196-8b54-479041696d92 req-de48a8c2-a6c0-4f27-bffe-d02bed1d4935 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1823614
May 27 09:32:40.588402 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54268) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:40.609020 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:40.755267 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e0824dc9-4ad0-45d1-9545-8ac65e8914dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:40.772786 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e0824dc9-4ad0-45d1-9545-8ac65e8914dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:40.777501 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e0824dc9-4ad0-45d1-9545-8ac65e8914dd admin admin] Usage tracker for resource:security_group_rule and tenant:6893d40b4ea441d3a29f6b4f449502ca is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:40.781261 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e0824dc9-4ad0-45d1-9545-8ac65e8914dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:40.788146 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e0824dc9-4ad0-45d1-9545-8ac65e8914dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:40.855324 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Allocated IP 172.27.1.212 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/02a9fc00-2d05-4d82-9153-0ec69147825b) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:32:40.860095 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-91b31b30-4100-4538-81f1-ba81bef132c3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Synchronizing usage tracker for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:security_group {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:32:40.890661 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e0824dc9-4ad0-45d1-9545-8ac65e8914dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:40.894861 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e0824dc9-4ad0-45d1-9545-8ac65e8914dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:40.902355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6bd38f53-7cef-4494-9df6-787596bee0af admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:40.906858 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-91b31b30-4100-4538-81f1-ba81bef132c3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Unset dirty status for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:security_group {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:32:40.908094 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-91b31b30-4100-4538-81f1-ba81bef132c3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--471285243&fields=id&tenant_id=f631f0ceb250483891019fb79b2e6b83 HTTP/1.1" status: 200  len: 267 time: 0.1195827
May 27 09:32:40.945525 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-e0824dc9-4ad0-45d1-9545-8ac65e8914dd admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6893d40b4ea441d3a29f6b4f449502ca&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3559783
May 27 09:32:40.946518 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0824dc9-4ad0-45d1-9545-8ac65e8914dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f796d1d-0d4c-4792-9b14-9d1aae199ef7,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:40.948916 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54282) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:40.951643 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e0824dc9-4ad0-45d1-9545-8ac65e8914dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:41.018776 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4c79fb36-079e-4d56-bd2d-4bd4ce97cf31 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.049986 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4c79fb36-079e-4d56-bd2d-4bd4ce97cf31 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.122625 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4c79fb36-079e-4d56-bd2d-4bd4ce97cf31 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.132711 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-686d290e-2a5c-4919-8532-d72e1bbc5a98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:41.154826 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c79fb36-079e-4d56-bd2d-4bd4ce97cf31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f796d1d-0d4c-4792-9b14-9d1aae199ef7,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:41.159818 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4c79fb36-079e-4d56-bd2d-4bd4ce97cf31 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:41.165110 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.170499 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4c79fb36-079e-4d56-bd2d-4bd4ce97cf31 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.173476 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-4c79fb36-079e-4d56-bd2d-4bd4ce97cf31 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/0f796d1d-0d4c-4792-9b14-9d1aae199ef7 HTTP/1.1" status: 204  len: 168 time: 0.2233829
May 27 09:32:41.180284 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-675b292c-df8a-4d54-ba2a-4c59cdd4e0b8 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:41.182436 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-675b292c-df8a-4d54-ba2a-4c59cdd4e0b8 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 816 time: 0.2672358
May 27 09:32:41.186183 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 07dac26a-791f-4736-a4b5-e13624421946 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:32:41.211795 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-62e425c6-eb07-433f-9a25-c7d5906e11aa tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/quotas/f631f0ceb250483891019fb79b2e6b83 HTTP/1.1" status: 200  len: 375 time: 0.0215812
May 27 09:32:41.303520 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.308857 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:41.331652 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 07dac26a-791f-4736-a4b5-e13624421946, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=07dac26a-791f-4736-a4b5-e13624421946,segment=NetworkSegment(111bd85e-76cc-4ba7-8f48-b8ddd0684287),segment_id=111bd85e-76cc-4ba7-8f48-b8ddd0684287)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:41.346595 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '07dac26a-791f-4736-a4b5-e13624421946', 'network_id': '7a08fef5-d013-4fc8-8260-e3fd96453634', 'port_id': '07dac26a-791f-4736-a4b5-e13624421946', 'mac_address': 'fa:16:3e:20:3b:3f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 363, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b5e42a76-0f30-4445-a1f6-5d4cc78bf42c', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:32:41.388751 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:32:41.396107 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:32:41.400687 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:32:41.411797 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.447926 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 07dac26a-791f-4736-a4b5-e13624421946 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:32:41.474207 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.477837 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-dae59779-12ee-4c56-a4ba-dcef8a40bdc7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Synchronizing usage tracker for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:32:41.478731 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 07dac26a-791f-4736-a4b5-e13624421946, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=07dac26a-791f-4736-a4b5-e13624421946,segment=NetworkSegment(111bd85e-76cc-4ba7-8f48-b8ddd0684287),segment_id=111bd85e-76cc-4ba7-8f48-b8ddd0684287)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:41.485911 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.488211 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-ab4450d8-5df1-43b8-a299-398f461b843e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:41.504960 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'Port': ['ID=02a9fc00-2d05-4d82-9153-0ec69147825b,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:41.522894 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:41.585530 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=07dac26a-791f-4736-a4b5-e13624421946,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:41.591900 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-dae59779-12ee-4c56-a4ba-dcef8a40bdc7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Unset dirty status for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:32:41.594945 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-dae59779-12ee-4c56-a4ba-dcef8a40bdc7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&fields=id HTTP/1.1" status: 200  len: 348 time: 0.3768783
May 27 09:32:41.613228 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.614235 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54296) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:41.615234 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.627852 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.628600 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.629445 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.630469 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.630839 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.632483 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.632858 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.633209 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.635285 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.635973 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.636706 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:41.645410 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:41.656627 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0ac32c05-ffff-4fcf-827e-a9c9aea154ff admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.679348 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-0ac32c05-ffff-4fcf-827e-a9c9aea154ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:41.685279 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-0ac32c05-ffff-4fcf-827e-a9c9aea154ff admin admin] Usage tracker for resource:security_group_rule and tenant:50e43182c98a414fa412cfcd3f38229a is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:41.695744 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-0ac32c05-ffff-4fcf-827e-a9c9aea154ff admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:41.704338 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-0ac32c05-ffff-4fcf-827e-a9c9aea154ff admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:41.725407 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['07dac26a-791f-4736-a4b5-e13624421946'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:32:41.878018 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1b05d76a-053d-4e92-a51a-e19e58e1aee8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.905050 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0ac32c05-ffff-4fcf-827e-a9c9aea154ff admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.912649 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0ac32c05-ffff-4fcf-827e-a9c9aea154ff admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:41.931504 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3c70a994-0bf6-4185-a972-aa9a26ca20ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:41.969108 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac32c05-ffff-4fcf-827e-a9c9aea154ff admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7fb645be-4802-4425-b064-27da9e9d7bea,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:41.976321 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0ac32c05-ffff-4fcf-827e-a9c9aea154ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:42.009622 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-0ac32c05-ffff-4fcf-827e-a9c9aea154ff admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=50e43182c98a414fa412cfcd3f38229a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3824384
May 27 09:32:42.011696 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54306) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:42.028666 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:42.085963 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-71d194fb-e6d3-4c65-bcdf-e0cbb3a6b282 service neutron] 10.222.0.30 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4589555
May 27 09:32:42.126882 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a953cd66-133d-4f43-8601-b1fa2619abef admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:42.174080 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a953cd66-133d-4f43-8601-b1fa2619abef admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:42.201852 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45147f22-ac10-4e3b-bfe9-4f722a8d8d30 req-60c822ad-3d5c-4ba6-ab4c-7038037f16ec tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:42.205226 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-45147f22-ac10-4e3b-bfe9-4f722a8d8d30 req-60c822ad-3d5c-4ba6-ab4c-7038037f16ec tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 944 time: 0.3754940
May 27 09:32:42.277873 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a953cd66-133d-4f43-8601-b1fa2619abef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:42.287788 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-677a4e6b-1c42-41c0-b728-6f328f87e44e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:42.310354 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a953cd66-133d-4f43-8601-b1fa2619abef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7fb645be-4802-4425-b064-27da9e9d7bea,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:42.316375 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a953cd66-133d-4f43-8601-b1fa2619abef admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:42.328788 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a953cd66-133d-4f43-8601-b1fa2619abef admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:42.331266 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-a953cd66-133d-4f43-8601-b1fa2619abef admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/7fb645be-4802-4425-b064-27da9e9d7bea HTTP/1.1" status: 204  len: 168 time: 0.3173161
May 27 09:32:42.377457 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:42.404109 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-45147f22-ac10-4e3b-bfe9-4f722a8d8d30 req-c9ddbf41-e04f-4d8e-a9c6-2bf3f5145ce9 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1872468
May 27 09:32:42.413470 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-937cc96e-2d99-48d1-9731-25f691575b74 service neutron] 10.222.0.30 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3264675
May 27 09:32:42.529601 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:42.536056 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:42.541948 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:42.806898 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-648e06f2-d42c-4000-8a75-719c85c62ec9 req-2f0e29dd-28fe-4b53-a283-29704a389e2d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 210 time: 0.0971825
May 27 09:32:42.819694 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'Port': ['ID=02a9fc00-2d05-4d82-9153-0ec69147825b,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:42.823224 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.281s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:42.824641 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:42.852625 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:42.853955 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 693 time: 2.6281939
May 27 09:32:43.187246 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 07dac26a-791f-4736-a4b5-e13624421946 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:32:43.190949 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-d8550605-cc66-425a-b691-25c899f01cf6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Synchronizing usage tracker for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:security_group {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:32:43.209972 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-d8550605-cc66-425a-b691-25c899f01cf6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Unset dirty status for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:security_group {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:32:43.216402 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-d8550605-cc66-425a-b691-25c899f01cf6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-securitygroup--1038474192&fields=id&tenant_id=3b2fb81840c64238b0ae0db08ca9b139 HTTP/1.1" status: 200  len: 267 time: 0.0949695
May 27 09:32:43.309301 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 07dac26a-791f-4736-a4b5-e13624421946 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:32:43.323095 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 07dac26a-791f-4736-a4b5-e13624421946 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:32:43.324769 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:43.478624 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-065ba6cb-1f5f-4768-a54a-fd759890d0aa tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:43.480463 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-065ba6cb-1f5f-4768-a54a-fd759890d0aa tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/networks?id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 200  len: 811 time: 0.2570288
May 27 09:32:43.502507 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-f6e126d5-b3d7-41d7-b0f8-d0430da242b1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/quotas/3b2fb81840c64238b0ae0db08ca9b139 HTTP/1.1" status: 200  len: 375 time: 0.0130947
May 27 09:32:43.521860 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:43.561266 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 07dac26a-791f-4736-a4b5-e13624421946, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=07dac26a-791f-4736-a4b5-e13624421946,segment=NetworkSegment(111bd85e-76cc-4ba7-8f48-b8ddd0684287),segment_id=111bd85e-76cc-4ba7-8f48-b8ddd0684287)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:43.563468 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07dac26a-791f-4736-a4b5-e13624421946'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:32:43.570659 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:43.573490 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:43.670258 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54376) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:43.753162 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-d11c22e2-da79-461d-8f8c-0f7f19945d13 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Synchronizing usage tracker for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:32:43.759489 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=07dac26a-791f-4736-a4b5-e13624421946,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:43.776023 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:43.782385 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93308738-1914-494c-8252-2438c829caab req-0eb13e0d-e507-4b18-be80-59e351499bc9 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:43.783984 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-93308738-1914-494c-8252-2438c829caab req-0eb13e0d-e507-4b18-be80-59e351499bc9 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 945 time: 0.1431267
May 27 09:32:43.785651 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-d11c22e2-da79-461d-8f8c-0f7f19945d13 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Unset dirty status for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:32:43.786955 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-d11c22e2-da79-461d-8f8c-0f7f19945d13 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&fields=id HTTP/1.1" status: 200  len: 348 time: 0.2667649
May 27 09:32:43.814138 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-208023189-network', 'tenant_id': 'b8df97a650014930beb6e52081be8e90'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:43.819396 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:43.823643 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Usage tracker for resource:network and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:43.828680 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:43.836817 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:43.851086 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Made reservation on behalf of b8df97a650014930beb6e52081be8e90 for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:32:43.855032 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:43.875737 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:43.892706 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:43.899555 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Usage tracker for resource:security_group_rule and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:43.905244 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:43.914133 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:43.917537 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-93308738-1914-494c-8252-2438c829caab req-5ce8ca76-6ea6-466e-ab3f-17317db23105 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1261866
May 27 09:32:43.985145 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-b600ff89-93c6-4480-a426-630fdc8ff79d service neutron] 10.222.0.30 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1793859
May 27 09:32:43.992942 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '07dac26a-791f-4736-a4b5-e13624421946', 'code': 200}
May 27 09:32:44.093750 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:44.100326 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:44.119610 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] vlan segment allocate from pool success with {'vlan_id': 393, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:32:44.126535 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f641cbd4-f6a7-492c-a067-438a6ca70f94 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:44.194917 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:44.195536 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Added segment c16c67eb-22c2-4695-a761-73d0611cf64a of type vlan for network d58a455f-cc80-4aa7-a530-ce993d4da5e4
May 27 09:32:44.200967 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-67f0b111-120c-49e4-831b-a473a6932846 req-1b48f8e5-d461-4907-a1e9-c81254dec2da tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 210 time: 0.0602772
May 27 09:32:44.265032 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ad280f3f-daa6-4330-8db6-11318c3b70eb service neutron] 10.222.0.30 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2623379
May 27 09:32:44.398700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9ba1dd74-b031-4983-b71f-2b448c236713,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:44.407150 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-913e472d-7b9d-4967-9daa-39b36ede89bb req-4a37951b-64fb-439c-b700-9f034577ffb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:44.409124 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-913e472d-7b9d-4967-9daa-39b36ede89bb req-4a37951b-64fb-439c-b700-9f034577ffb0 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 1098 time: 0.0948772
May 27 09:32:44.419302 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-9223593b-3a87-4db9-89f2-842d34f469d6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:44.422315 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-9223593b-3a87-4db9-89f2-842d34f469d6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.11 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 816 time: 0.2976048
May 27 09:32:44.423231 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.297s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:44.474222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:44.524554 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-85dc7d7e-f0fd-477a-9048-488c75849b97 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Synchronizing usage tracker for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:security_group {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:32:44.543229 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:44.544173 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-85dc7d7e-f0fd-477a-9048-488c75849b97 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Unset dirty status for tenant:f631f0ceb250483891019fb79b2e6b83 on resource:security_group {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:32:44.545533 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-85dc7d7e-f0fd-477a-9048-488c75849b97 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=f631f0ceb250483891019fb79b2e6b83 HTTP/1.1" status: 200  len: 379 time: 0.0977428
May 27 09:32:44.547152 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:44.547969 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:44.555985 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-31081f64-5c8a-4200-bafb-0f0949ba2353 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:44.582362 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'port': {'device_id': '652a6c44-8948-4153-be12-c818fc126b19', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'admin_state_up': True, 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'security_groups': ['3f848da4-f4c2-436d-acc8-dc0cd5d695b1']}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:44.693473 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-913e472d-7b9d-4967-9daa-39b36ede89bb req-1ffd8a11-c986-4898-a2c2-4b9a49e00590 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2737529
May 27 09:32:44.720170 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Pushing event updated for resources: {'Network': ['ID=d58a455f-cc80-4aa7-a530-ce993d4da5e4,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:44.721034 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-13af240c-1f11-4601-a2be-d59eae85b2ee req-cf094495-101e-4253-87ff-3a4a63a3d94d tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 210 time: 0.2179296
May 27 09:32:44.732212 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.173s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:44.736950 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network d58a455f-cc80-4aa7-a530-ce993d4da5e4 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:32:44.866528 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54404) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:44.898438 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 1.2242496
May 27 09:32:44.901702 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54410) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:44.909278 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Request body: {'subnet': {'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-208023189-subnet', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'ip_version': 4}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:44.914841 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:44.919427 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Usage tracker for resource:subnet and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:44.923718 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:44.927011 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:44.927223 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:44.930318 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:44.939271 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:44.945545 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Made reservation on behalf of b8df97a650014930beb6e52081be8e90 for: {'subnet': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:32:44.950514 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Made reservation on behalf of f631f0ceb250483891019fb79b2e6b83 for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:32:44.952951 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2399631'] for subnet, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:44.954498 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:45.173549 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6e1a23a3-f646-41f7-82a9-4d3aa040fab3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:45.198428 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Allocated IP 172.20.0.9 (624aa867-a71e-4343-8899-4e49257cd000/77149737-85de-41af-b8e2-0509a46f467d/bd7e74f7-d502-4ed5-b38d-566afcb0be1a) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:32:45.237361 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-6e1a23a3-f646-41f7-82a9-4d3aa040fab3 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:45.253040 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-6e1a23a3-f646-41f7-82a9-4d3aa040fab3 admin admin] Usage tracker for resource:security_group_rule and tenant:15c20a1b1df541f29745ce3629a5a571 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:45.263171 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-6e1a23a3-f646-41f7-82a9-4d3aa040fab3 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:45.279842 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-6e1a23a3-f646-41f7-82a9-4d3aa040fab3 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:45.382835 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0acbeb6a-0978-46d3-971a-10616e0362e2 req-27dc9d2c-4d70-41b8-9669-0f1a172cb5f5 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:45.384787 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0acbeb6a-0978-46d3-971a-10616e0362e2 req-27dc9d2c-4d70-41b8-9669-0f1a172cb5f5 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 945 time: 0.3034403
May 27 09:32:45.464972 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:45.473984 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-79929c89-61c9-40b9-8120-ca9fb771bfb1 req-4a95132e-738c-4b9c-8d59-ed2a2fbf2593 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 210 time: 0.0855250
May 27 09:32:45.491129 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Transition to ACTIVE for port object bd7e74f7-d502-4ed5-b38d-566afcb0be1a will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:45.524325 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0acbeb6a-0978-46d3-971a-10616e0362e2 req-2513bbea-bb1b-4a89-a128-f5d6a06b0595 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0942378
May 27 09:32:45.527610 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:45.546984 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:45.594119 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Network 624aa867-a71e-4343-8899-4e49257cd000 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:32:45.602808 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:32:45.614371 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:32:45.679466 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6e1a23a3-f646-41f7-82a9-4d3aa040fab3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:45.689897 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6e1a23a3-f646-41f7-82a9-4d3aa040fab3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:45.698763 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-005d09ec-56a9-4eac-916d-524836e42125 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:45.716063 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event updated for resources: {'Port': ['ID=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:45.722138 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:45.736722 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:45.740222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:45.760739 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-6e1a23a3-f646-41f7-82a9-4d3aa040fab3 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=15c20a1b1df541f29745ce3629a5a571&name=default HTTP/1.1" status: 200  len: 2979 time: 0.8925443
May 27 09:32:45.761781 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54422) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:45.765665 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1a23a3-f646-41f7-82a9-4d3aa040fab3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45dd49d4-5893-456a-8d5e-3acebf71ea04,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:45.770695 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-6e1a23a3-f646-41f7-82a9-4d3aa040fab3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:45.910483 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 933 time: 1.3574195
May 27 09:32:45.927874 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Request body: {'port': {'device_id': '652a6c44-8948-4153-be12-c818fc126b19', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:45.958538 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-731fa5e1-78df-49fd-b19d-d44972968ce4 req-a8c93a9d-62eb-41a2-a1f7-eb0607eda7e4 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 210 time: 0.0571253
May 27 09:32:45.963902 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2157992', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2399641'] for subnet, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:45.970913 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:46.010396 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-7cd928b4-331a-435f-99a9-a91dcfe09261 None None] Provisioning for port bd7e74f7-d502-4ed5-b38d-566afcb0be1a completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:32:46.018371 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-7cd928b4-331a-435f-99a9-a91dcfe09261 None None] Provisioning complete for port bd7e74f7-d502-4ed5-b38d-566afcb0be1a triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:32:46.022743 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-7cd928b4-331a-435f-99a9-a91dcfe09261 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.068093 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-187122a4-2a13-4a10-a50f-1357714b6358 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.115714 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-7cd928b4-331a-435f-99a9-a91dcfe09261 None None] Port bd7e74f7-d502-4ed5-b38d-566afcb0be1a cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:32:46.131515 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-187122a4-2a13-4a10-a50f-1357714b6358 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.144120 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.150640 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3187e919-f2c3-422d-8e9c-3d158ef72b40,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:46.157711 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:46.168867 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Checking segment: {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:32:46.169230 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Network hostable DHCP agents. Network: d58a455f-cc80-4aa7-a530-ce993d4da5e4, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91821) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:32:46.240195 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-7993e653-ba38-4cac-8c0f-2273ba87a599 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:46.241846 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-7993e653-ba38-4cac-8c0f-2273ba87a599 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.11 "GET /v2.0/networks?id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 200  len: 811 time: 0.2720914
May 27 09:32:46.243005 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Network d58a455f-cc80-4aa7-a530-ce993d4da5e4 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91821) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:32:46.268417 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, d58a455f-cc80-4aa7-a530-ce993d4da5e4) {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:32:46.282719 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a10070b5-d57c-42ca-b62b-4381213f03bb None None] Network d58a455f-cc80-4aa7-a530-ce993d4da5e4 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:32:46.293302 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:46.294083 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.319532 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-49991f8f-e990-49d3-84e7-92e8ea312393 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=3b2fb81840c64238b0ae0db08ca9b139 HTTP/1.1" status: 200  len: 380 time: 0.0682652
May 27 09:32:46.330810 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'port': {'device_id': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'admin_state_up': True, 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'security_groups': ['678d7678-18e3-4d7c-aecd-a992255c87ef']}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:46.336292 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-187122a4-2a13-4a10-a50f-1357714b6358 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.348568 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c12dd45b-b693-4b55-93e4-ca109ca9b350 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:46.362642 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-72030738-8b1c-476b-81eb-d2cd38246422 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.4592154
May 27 09:32:46.364993 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-187122a4-2a13-4a10-a50f-1357714b6358 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=45dd49d4-5893-456a-8d5e-3acebf71ea04,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:46.367049 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54430) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:46.375250 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-187122a4-2a13-4a10-a50f-1357714b6358 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:46.381894 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:46.397327 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:46.403675 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-187122a4-2a13-4a10-a50f-1357714b6358 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.405920 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-187122a4-2a13-4a10-a50f-1357714b6358 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/45dd49d4-5893-456a-8d5e-3acebf71ea04 HTTP/1.1" status: 204  len: 168 time: 0.6420987
May 27 09:32:46.406622 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Usage tracker for resource:router and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:46.412453 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:46.437727 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:46.528415 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:46.534359 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3812772', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1963'] for router, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.535419 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3855012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3811180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3881146', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1952'] for router, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.554344 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:46.582575 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Made reservation on behalf of 3b2fb81840c64238b0ae0db08ca9b139 for: {'port': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:32:46.587717 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.590742 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.672030 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp391d76a4-97d4-5c01-84fd-9bc405269bae-d58a455f-cc80-4aa7-a530-ce993d4da5e4', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40'}]}} from dv-cinder-772623-6-iscsi. {{(pid=91822) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 27 09:32:46.673093 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:46.881619 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.db_base_plugin_common [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Allocated IP 172.20.0.2 (d58a455f-cc80-4aa7-a530-ce993d4da5e4/3187e919-f2c3-422d-8e9c-3d158ef72b40/776051f2-913a-4ae9-986b-d2455e629b25) {{(pid=91822) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:32:46.958231 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-719e95cd-5e1f-4c19-9a49-7e56357d0de7 req-a8676a7e-d0f2-468b-9e9a-85a4045a0e76 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:46.959982 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-719e95cd-5e1f-4c19-9a49-7e56357d0de7 req-a8676a7e-d0f2-468b-9e9a-85a4045a0e76 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 931 time: 0.3252773
May 27 09:32:46.972012 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84207d3b-7237-40a9-8b28-9e8beb7c6acf req-ac41f709-7817-45af-bcff-272a38bbf1a8 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:46.979856 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-84207d3b-7237-40a9-8b28-9e8beb7c6acf req-ac41f709-7817-45af-bcff-272a38bbf1a8 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 945 time: 0.2358289
May 27 09:32:47.034740 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3811195', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3812794', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2006'] for router, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:47.044533 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bd7e74f7-d502-4ed5-b38d-566afcb0be1a {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:32:47.049044 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Allocated IP 172.20.0.14 (bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6/b2c650ce-3329-4545-aaac-c69109472b2b/524ba62d-2814-4825-b3ab-2f96c42b5a0c) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:32:47.055723 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:47.097748 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Transition to ACTIVE for port object bd7e74f7-d502-4ed5-b38d-566afcb0be1a will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:47.102989 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-84207d3b-7237-40a9-8b28-9e8beb7c6acf req-e5072e2e-cff1-4728-be13-07ab611338db tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1220102
May 27 09:32:47.160876 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-719e95cd-5e1f-4c19-9a49-7e56357d0de7 req-1e360662-aa93-4cd4-a650-61071e8c5e08 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1614335
May 27 09:32:47.171515 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:47.177430 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:47.297582 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Notify callbacks [] for port, precommit_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:47.325398 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Transition to ACTIVE for port object 776051f2-913a-4ae9-986b-d2455e629b25 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:47.377896 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Transition to ACTIVE for port object 776051f2-913a-4ae9-986b-d2455e629b25 will not be triggered until provisioned by entity DHCP. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:47.394569 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:47.412240 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:47.420336 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Pushing event updated for resources: {'Port': ['ID=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:47.449715 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.271s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:47.589367 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Network d58a455f-cc80-4aa7-a530-ce993d4da5e4 is already hosted by enough agents. {{(pid=91822) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:32:47.595522 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.base_scheduler [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Resources bound (agent type, host, resource id):  {{(pid=91822) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:32:47.606175 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Received port after_create {{(pid=91822) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:32:47.628617 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Attempting to bind port bd7e74f7-d502-4ed5-b38d-566afcb0be1a on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:32:47.628953 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Attempting to bind port bd7e74f7-d502-4ed5-b38d-566afcb0be1a by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:32:47.629271 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Attempting to bind port bd7e74f7-d502-4ed5-b38d-566afcb0be1a on network 624aa867-a71e-4343-8899-4e49257cd000 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:32:47.654483 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Port bd7e74f7-d502-4ed5-b38d-566afcb0be1a on network 624aa867-a71e-4343-8899-4e49257cd000 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:32:47.655044 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Attempting to bind port bd7e74f7-d502-4ed5-b38d-566afcb0be1a on network 624aa867-a71e-4343-8899-4e49257cd000 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:32:47.668783 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b42a4ff6-3c92-4919-a03b-41b7daf2f90a req-a4761298-a04e-474b-9b54-0cfa6409a730 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 210 time: 0.1027796
May 27 09:32:47.687986 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 32, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:32:47.689200 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Checking segment: {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:32:47.690046 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Bound using segment: {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:32:47.696510 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Bound port: bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2a4e0452-89d7-4dda-9abd-65b3d289e707', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '624aa867-a71e-4343-8899-4e49257cd000'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:32:47.697971 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:47.716409 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Pushing event updated for resources: {'Port': ['ID=776051f2-913a-4ae9-986b-d2455e629b25,revision_number=1']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:47.735210 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.321s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:47.781680 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:47.803755 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Transition to ACTIVE for port object 524ba62d-2814-4825-b3ab-2f96c42b5a0c will not be triggered until provisioned by entity DHCP. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:47.840994 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:47.853517 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:47.873308 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Attempting to bind port 776051f2-913a-4ae9-986b-d2455e629b25 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:32:47.873913 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Attempting to bind port 776051f2-913a-4ae9-986b-d2455e629b25 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:32:47.874953 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Attempting to bind port 776051f2-913a-4ae9-986b-d2455e629b25 on network d58a455f-cc80-4aa7-a530-ce993d4da5e4 {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:32:47.886807 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 32, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:32:47.888423 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Checking segment: {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:32:47.889338 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:47.890239 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Bound using segment: {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:32:47.891210 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Bound port: 776051f2-913a-4ae9-986b-d2455e629b25, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:32:47.892095 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:48.060627 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event updated for resources: {'Port': ['ID=524ba62d-2814-4825-b3ab-2f96c42b5a0c,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:48.085949 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.233s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:48.110020 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] For port 776051f2-913a-4ae9-986b-d2455e629b25, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:32:48.115609 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:32:48.115959 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] For port 776051f2-913a-4ae9-986b-d2455e629b25, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=776051f2-913a-4ae9-986b-d2455e629b25,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:32:48.118890 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:32:48.125566 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:48.134221 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:32:48.136479 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:48.281906 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:32:48.290804 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:32:48.311514 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:48.316538 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Pushing event updated for resources: {'Port': ['ID=776051f2-913a-4ae9-986b-d2455e629b25,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:48.329635 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7153a103-aa33-418b-beeb-7554a05c382b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:48.330116 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:48.355696 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:48.356393 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:48.365843 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:48.449591 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:48.449825 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 2.1231260
May 27 09:32:48.461809 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Request body: {'port': {'device_id': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:48.462537 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:48.463671 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:48.466133 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] 10.222.0.11 "PUT /v2.0/ports/bd7e74f7-d502-4ed5-b38d-566afcb0be1a HTTP/1.1" status: 200  len: 1093 time: 2.5425138
May 27 09:32:48.532254 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:32:48.611472 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-77e8ae23-da27-4cb2-a728-488f5de30a52 None None] Provisioning for port 524ba62d-2814-4825-b3ab-2f96c42b5a0c completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:32:48.619795 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-77e8ae23-da27-4cb2-a728-488f5de30a52 None None] Provisioning complete for port 524ba62d-2814-4825-b3ab-2f96c42b5a0c triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:32:48.621335 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-77e8ae23-da27-4cb2-a728-488f5de30a52 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:48.798650 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Pushing event updated for resources: {'Port': ['ID=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:48.813482 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.484s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:48.898338 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-77e8ae23-da27-4cb2-a728-488f5de30a52 None None] Port 524ba62d-2814-4825-b3ab-2f96c42b5a0c cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:32:48.953416 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-189c2fac-2160-4d0d-be7d-5ba793b25216 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:48.954998 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-189c2fac-2160-4d0d-be7d-5ba793b25216 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 1096 time: 0.4134653
May 27 09:32:49.035906 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:49.236657 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7237d1bc-cd05-4b14-a385-36d1f20e9f38 req-bef040a3-1273-4970-a403-651153c0b145 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:49.239873 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7237d1bc-cd05-4b14-a385-36d1f20e9f38 req-bef040a3-1273-4970-a403-651153c0b145 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.6640816
May 27 09:32:49.241423 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-c93159b7-515f-457f-909c-438abc530dde service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a HTTP/1.1" status: 200  len: 217 time: 0.2351542
May 27 09:32:49.242697 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Allocated IP 172.27.1.252 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/8c399902-7a66-4c08-a29d-47eb71f37136) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:32:49.266120 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'status': 'completed', 'code': 200}
May 27 09:32:49.428344 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-e6a815e8-8c6c-4216-a36a-9ce6de7a9c02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:49.429878 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-e6a815e8-8c6c-4216-a36a-9ce6de7a9c02 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 200  len: 855 time: 0.1483600
May 27 09:32:49.551482 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:49.552501 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7237d1bc-cd05-4b14-a385-36d1f20e9f38 req-26bc942b-7806-40ab-b331-017c4717b570 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2992332
May 27 09:32:49.596072 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:49.609182 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:49.639049 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92902ccf-1308-4e04-9b19-8b8fe215d60e req-1aae3b48-44de-410c-afdf-5aecaf2f06cb tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:49.640101 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-92902ccf-1308-4e04-9b19-8b8fe215d60e req-1aae3b48-44de-410c-afdf-5aecaf2f06cb tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Synchronizing usage tracker for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:32:49.681664 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:32:49.691966 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-f3d09675-7380-44df-8c49-79b4d7fb1663 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:49.693410 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-f3d09675-7380-44df-8c49-79b4d7fb1663 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=624aa867-a71e-4343-8899-4e49257cd000&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2537763
May 27 09:32:49.697060 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:32:49.701094 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:32:49.719607 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-92902ccf-1308-4e04-9b19-8b8fe215d60e req-1aae3b48-44de-410c-afdf-5aecaf2f06cb tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Unset dirty status for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:32:49.725791 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-92902ccf-1308-4e04-9b19-8b8fe215d60e req-1aae3b48-44de-410c-afdf-5aecaf2f06cb tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 932 time: 0.4034851
May 27 09:32:49.760837 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 524ba62d-2814-4825-b3ab-2f96c42b5a0c {{(pid=91821) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:32:49.772151 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:49.773909 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Pushing event updated for resources: {'Port': ['ID=8c399902-7a66-4c08-a29d-47eb71f37136,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:49.782188 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:49.805693 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Transition to ACTIVE for port object 524ba62d-2814-4825-b3ab-2f96c42b5a0c will not be triggered until provisioned by entity L2. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:49.809183 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-92902ccf-1308-4e04-9b19-8b8fe215d60e req-76385ed5-185e-4552-b61e-a6ae3a32d36e tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0743952
May 27 09:32:49.816415 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:49.822076 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-acff29de-f5e3-4a08-9db4-36a8055ea31e tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:49.842264 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eea41078-45a2-45cc-90a8-e2e522dc851a None None] Network d58a455f-cc80-4aa7-a530-ce993d4da5e4 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:32:49.932667 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-9bf4d6b4-ed7e-4c81-a4d3-7ffe17647244 None None] Provisioning for port 776051f2-913a-4ae9-986b-d2455e629b25 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:32:50.000636 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Pushing event updated for resources: {'Port': ['ID=524ba62d-2814-4825-b3ab-2f96c42b5a0c,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:50.009021 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.187s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:50.120082 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Attempting to bind port 524ba62d-2814-4825-b3ab-2f96c42b5a0c on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:32:50.120779 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Attempting to bind port 524ba62d-2814-4825-b3ab-2f96c42b5a0c by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:32:50.121439 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Attempting to bind port 524ba62d-2814-4825-b3ab-2f96c42b5a0c on network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:32:50.129865 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Port 524ba62d-2814-4825-b3ab-2f96c42b5a0c on network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:32:50.130717 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Attempting to bind port 524ba62d-2814-4825-b3ab-2f96c42b5a0c on network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:32:50.133464 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-a9d32b21-af74-4221-bd20-e4b657827ed6 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.4019773
May 27 09:32:50.139091 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 32, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:32:50.139647 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Checking segment: {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:32:50.140145 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Bound using segment: {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:32:50.140700 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Bound port: 524ba62d-2814-4825-b3ab-2f96c42b5a0c, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3f4b268e-0da0-49f5-8985-9d93ceab74d6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6'}}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:32:50.141258 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:50.255569 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] For port 524ba62d-2814-4825-b3ab-2f96c42b5a0c, host hv-cinder-77262, cleared binding levels {{(pid=91821) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:32:50.259727 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] For port 524ba62d-2814-4825-b3ab-2f96c42b5a0c, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=524ba62d-2814-4825-b3ab-2f96c42b5a0c,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91821) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:32:50.274945 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:50.291402 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ca487132-1755-457a-904d-8c471e22cd39 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:50.387140 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 776051f2-913a-4ae9-986b-d2455e629b25 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:32:50.401317 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:50.402187 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:50.404643 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] 10.222.0.11 "PUT /v2.0/ports/524ba62d-2814-4825-b3ab-2f96c42b5a0c HTTP/1.1" status: 200  len: 1094 time: 1.9475694
May 27 09:32:50.407011 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'tag': '524ba62d-2814-4825-b3ab-2f96c42b5a0c'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:32:50.445378 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Pushing event updated for resources: {'Port': ['ID=524ba62d-2814-4825-b3ab-2f96c42b5a0c,revision_number=3']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:50.462058 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:50.540635 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'tag': '524ba62d-2814-4825-b3ab-2f96c42b5a0c', 'status': 'completed', 'code': 200}
May 27 09:32:50.606187 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-baf9f0d9-e04d-43f9-b844-573f3790992f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:50.607684 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-baf9f0d9-e04d-43f9-b844-573f3790992f service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 1097 time: 0.1441307
May 27 09:32:50.657359 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 776051f2-913a-4ae9-986b-d2455e629b25 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:32:50.662205 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-eef0137d-7057-4c68-baba-2e53bfcfea60 None None] Provisioning complete for port 776051f2-913a-4ae9-986b-d2455e629b25 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:32:50.662711 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-eef0137d-7057-4c68-baba-2e53bfcfea60 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:50.741815 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 776051f2-913a-4ae9-986b-d2455e629b25 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:32:50.742087 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:50.805268 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-953204ed-be6f-4575-9508-149b1245101d tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/networks?tenant_id=46febd5e53624a3cb1c861af3e9c8d61&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0683630
May 27 09:32:50.817485 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-a1e10d33-8d25-436e-ba26-c8d6ea903999 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=524ba62d-2814-4825-b3ab-2f96c42b5a0c HTTP/1.1" status: 200  len: 217 time: 0.2021198
May 27 09:32:50.917290 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:51.012087 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:51.016062 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8e5a09cf-9bce-4ac3-8130-1d16854f323d req-c1b21697-5fd0-4a5b-9163-d46760214ec4 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.8223360
May 27 09:32:51.029338 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-eef0137d-7057-4c68-baba-2e53bfcfea60 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:51.110258 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 776051f2-913a-4ae9-986b-d2455e629b25, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=776051f2-913a-4ae9-986b-d2455e629b25,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:51.152456 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-efb60e63-61ce-4dd8-b726-bb9726d61938 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:51.154008 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-efb60e63-61ce-4dd8-b726-bb9726d61938 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b2c650ce-3329-4545-aaac-c69109472b2b HTTP/1.1" status: 200  len: 850 time: 0.1668167
May 27 09:32:51.175461 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:51.190702 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:51.276019 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.db.api [None req-eef0137d-7057-4c68-baba-2e53bfcfea60 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=91822) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}}
May 27 09:32:51.276698 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_db.api [None req-eef0137d-7057-4c68-baba-2e53bfcfea60 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}}
May 27 09:32:51.281631 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-012e590a-913c-43bf-a7c1-76aa13ae4f6d tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:51.283206 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-012e590a-913c-43bf-a7c1-76aa13ae4f6d tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.4683893
May 27 09:32:51.289268 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=776051f2-913a-4ae9-986b-d2455e629b25,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:51.292738 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:51.306031 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-386713b8-4f8a-46dd-8354-27513f870605 req-6bf210cb-0787-4072-b33a-3bd11fbd0171 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:51.307899 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-386713b8-4f8a-46dd-8354-27513f870605 req-6bf210cb-0787-4072-b33a-3bd11fbd0171 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.4567015
May 27 09:32:51.338039 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-7da19e9a-41a7-43e5-bea8-f53e98cef0e4 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/quotas/46febd5e53624a3cb1c861af3e9c8d61 HTTP/1.1" status: 200  len: 375 time: 0.0285957
May 27 09:32:51.347528 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-998b92aa-849d-413c-b78b-2e87ac3abf77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:51.349103 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-998b92aa-849d-413c-b78b-2e87ac3abf77 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1849308
May 27 09:32:51.351105 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b42989-d5f7-4ef2-b1ed-437e6f634d45 req-5d644e61-f93c-41d1-be0a-cd5a8168af0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:51.352735 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-62b42989-d5f7-4ef2-b1ed-437e6f634d45 req-5d644e61-f93c-41d1-be0a-cd5a8168af0d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 1096 time: 0.2767556
May 27 09:32:51.444261 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-1198e284-dec4-4af0-a1d1-d13a7575fc4e tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=46febd5e53624a3cb1c861af3e9c8d61&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0921094
May 27 09:32:51.447618 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-386713b8-4f8a-46dd-8354-27513f870605 req-85eb60e6-21c8-4bc9-bc2b-236f77511f6c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1267698
May 27 09:32:51.586127 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3812787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3811082'] for router, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:51.599678 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-2db8e983-c1d8-4269-b3d0-5775eac2568b service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1996682
May 27 09:32:51.735591 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b42989-d5f7-4ef2-b1ed-437e6f634d45 req-a2a02399-4e2d-415f-ab2a-3130a188903d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:51.737149 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-62b42989-d5f7-4ef2-b1ed-437e6f634d45 req-a2a02399-4e2d-415f-ab2a-3130a188903d service neutron] 10.222.0.11 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 917 time: 0.3728886
May 27 09:32:51.798636 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b1dc4031-92e2-46de-8f76-1ee65108aae9 req-8ed919ee-b048-4121-83b1-93b22a4dc27f tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 210 time: 0.1491504
May 27 09:32:51.886220 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-62b42989-d5f7-4ef2-b1ed-437e6f634d45 req-e4814ff5-d837-41aa-92fd-aa56b58dd5a3 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a HTTP/1.1" status: 200  len: 217 time: 0.1398308
May 27 09:32:51.886757 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85ad71bf-dff5-4385-9b81-d6129533ed5e req-78bc012d-7d52-4920-ad1b-cca53d00cd78 service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2794051
May 27 09:32:51.923877 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a50f212-2d33-4695-a7fa-f03b9215f9ab req-7d888827-be51-445c-8942-158f2d8a4ee1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:51.926655 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7a50f212-2d33-4695-a7fa-f03b9215f9ab req-7d888827-be51-445c-8942-158f2d8a4ee1 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 944 time: 0.2843933
May 27 09:32:52.023697 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b42989-d5f7-4ef2-b1ed-437e6f634d45 req-92bc1afc-c34c-4b76-ae01-6b1b58b2b8f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:52.025195 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-62b42989-d5f7-4ef2-b1ed-437e6f634d45 req-92bc1afc-c34c-4b76-ae01-6b1b58b2b8f4 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 200  len: 855 time: 0.0964417
May 27 09:32:52.030233 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7a50f212-2d33-4695-a7fa-f03b9215f9ab req-31188df3-a3f7-46ca-b85d-945cdb213072 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0963790
May 27 09:32:52.060245 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33194611-7982-46fe-8200-04a8b651636f req-bdc5ee4a-8be6-4d9a-bd33-1d16c2df7e14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:52.061837 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-33194611-7982-46fe-8200-04a8b651636f req-bdc5ee4a-8be6-4d9a-bd33-1d16c2df7e14 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 1097 time: 0.1118371
May 27 09:32:52.137260 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 is scheduled to L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 with binding_index 1 {{(pid=91820) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 27 09:32:52.209101 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b42989-d5f7-4ef2-b1ed-437e6f634d45 req-76eb14c4-a4de-4172-8d54-59adef019221 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:52.210579 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-62b42989-d5f7-4ef2-b1ed-437e6f634d45 req-76eb14c4-a4de-4172-8d54-59adef019221 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=624aa867-a71e-4343-8899-4e49257cd000&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1701429
May 27 09:32:52.228484 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33194611-7982-46fe-8200-04a8b651636f req-aaf03793-cc25-41ba-8b9e-b57bdb9c8eb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:52.230051 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-33194611-7982-46fe-8200-04a8b651636f req-aaf03793-cc25-41ba-8b9e-b57bdb9c8eb7 service neutron] 10.222.0.11 "GET /v2.0/networks?id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 200  len: 912 time: 0.1618655
May 27 09:32:52.319071 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 776051f2-913a-4ae9-986b-d2455e629b25 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:32:52.321335 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-33194611-7982-46fe-8200-04a8b651636f req-85f29e18-7c9d-4c95-8b3e-c7e6dc7bcb46 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=524ba62d-2814-4825-b3ab-2f96c42b5a0c HTTP/1.1" status: 200  len: 217 time: 0.0826502
May 27 09:32:52.382184 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:32:52.393502 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Sync routers for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:32:52.397593 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33194611-7982-46fe-8200-04a8b651636f req-8bd06a7e-61f3-4ddc-b0e4-3bb3497fedaf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:52.399241 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-33194611-7982-46fe-8200-04a8b651636f req-8bd06a7e-61f3-4ddc-b0e4-3bb3497fedaf service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b2c650ce-3329-4545-aaac-c69109472b2b HTTP/1.1" status: 200  len: 850 time: 0.0708323
May 27 09:32:52.406330 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 776051f2-913a-4ae9-986b-d2455e629b25 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:32:52.406740 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:52.437154 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:32:52.437932 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec853190>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:52.504589 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33194611-7982-46fe-8200-04a8b651636f req-b6cd8f7f-3593-4814-add0-af687f943573 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:52.506051 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-33194611-7982-46fe-8200-04a8b651636f req-b6cd8f7f-3593-4814-add0-af687f943573 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0992928
May 27 09:32:52.684068 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Notify callbacks [] for router, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:52.689313 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 6.3159544
May 27 09:32:52.689991 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54524) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:52.765815 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-33194611-7982-46fe-8200-04a8b651636f req-78c746d3-131a-47f9-b343-ff56a8ed5a02 service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2506154
May 27 09:32:52.776786 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:32:52.800025 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-62b42989-d5f7-4ef2-b1ed-437e6f634d45 req-7964cd80-d050-471f-8958-b2dda39fe820 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5804448
May 27 09:32:52.994401 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52dd4478-c308-45e6-ad86-bf0437ee01c5 req-ba80736f-141d-44c1-8627-377c449e4c99 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:52.996151 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-52dd4478-c308-45e6-ad86-bf0437ee01c5 req-ba80736f-141d-44c1-8627-377c449e4c99 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.3234761
May 27 09:32:53.103319 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9ee686b0-c447-4375-84ea-a9e3f12b33c1 req-f12471b1-c510-4240-bae7-287f07bbcbcf tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 210 time: 0.1007810
May 27 09:32:53.115453 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-62b42989-d5f7-4ef2-b1ed-437e6f634d45 req-9d419452-251e-43d6-9b61-72cdf91e0307 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2948058
May 27 09:32:53.119211 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-52dd4478-c308-45e6-ad86-bf0437ee01c5 req-3ce36b40-6612-4e91-8b5b-d8a333cf68bd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1155100
May 27 09:32:53.181239 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec853190>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:50Z', 'revision_number': 3, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:53.190944 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Checking router: 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:32:53.191430 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Updating router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 port 8c399902-7a66-4c08-a29d-47eb71f37136 binding host dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:32:53.205696 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-33194611-7982-46fe-8200-04a8b651636f req-43094052-6400-4416-b74a-5b497d10c649 service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.4306889
May 27 09:32:53.273865 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:53.344209 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c63efa2e-eec4-48e7-a734-4693afca6306 req-cd7a39a0-ee29-43b1-8ecc-4ed91250128d tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:53.346252 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c63efa2e-eec4-48e7-a734-4693afca6306 req-cd7a39a0-ee29-43b1-8ecc-4ed91250128d tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 944 time: 0.1009917
May 27 09:32:53.423889 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-876120af-babe-40e4-bc99-0bacd7ed8139 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.11 "GET /v2.0/networks?tenant_id=46febd5e53624a3cb1c861af3e9c8d61&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0565205
May 27 09:32:53.427171 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c63efa2e-eec4-48e7-a734-4693afca6306 req-edff244a-659d-4843-8cb0-488bd5241751 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0679781
May 27 09:32:53.693062 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Notify callbacks [] for port, precommit_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:53.705079 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Transition to ACTIVE for port object 8c399902-7a66-4c08-a29d-47eb71f37136 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:53.713724 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:53.719604 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:53.750321 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-7005611e-c79b-4ae6-add8-c673bddc520b tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:53.752033 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-7005611e-c79b-4ae6-add8-c673bddc520b tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 769 time: 0.3209901
May 27 09:32:53.767486 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Request body: {'port': {'device_id': '6757e96f-c173-47bc-ba37-1fc4e9b0347d', 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405', 'admin_state_up': True, 'tenant_id': '46febd5e53624a3cb1c861af3e9c8d61'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:53.838579 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Attempting to bind port 8c399902-7a66-4c08-a29d-47eb71f37136 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:32:53.838956 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Attempting to bind port 8c399902-7a66-4c08-a29d-47eb71f37136 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:32:53.839329 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Attempting to bind port 8c399902-7a66-4c08-a29d-47eb71f37136 on network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:32:53.849216 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77265e01-580c-41db-8096-8a660d058be7 None None] Pushing event updated for resources: {'Port': ['ID=8c399902-7a66-4c08-a29d-47eb71f37136,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:53.851784 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 32, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:32:53.852171 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Checking segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:32:53.852580 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:53.852969 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Bound using segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:32:53.853485 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Bound port: 8c399902-7a66-4c08-a29d-47eb71f37136, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:32:53.853862 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:53.882792 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-77265e01-580c-41db-8096-8a660d058be7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:53.929283 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] For port 8c399902-7a66-4c08-a29d-47eb71f37136, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:32:53.932808 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] For port 8c399902-7a66-4c08-a29d-47eb71f37136, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=8c399902-7a66-4c08-a29d-47eb71f37136,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:32:53.939352 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:53.943488 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:54.007263 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:54.013803 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:54.023250 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Usage tracker for resource:port and tenant:46febd5e53624a3cb1c861af3e9c8d61 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:54.023828 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:32:54.024428 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec853190>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:54.027525 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:54.038180 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:54.083170 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Made reservation on behalf of 46febd5e53624a3cb1c861af3e9c8d61 for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:32:54.086675 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:54.088811 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77265e01-580c-41db-8096-8a660d058be7 None None] Pushing event updated for resources: {'Port': ['ID=8c399902-7a66-4c08-a29d-47eb71f37136,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:54.095053 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-77265e01-580c-41db-8096-8a660d058be7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:54.109781 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:54.141937 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:54.148898 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Usage tracker for resource:security_group_rule and tenant:46febd5e53624a3cb1c861af3e9c8d61 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:54.152629 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:54.238346 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:32:54.319248 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:54.451317 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Allocated IP 172.20.0.1 (d58a455f-cc80-4aa7-a530-ce993d4da5e4/3187e919-f2c3-422d-8e9c-3d158ef72b40/5b3c7db8-4288-45a7-a18e-484e4c69dfbb) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:32:54.488825 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1151b517-4b27-4451-896c-ed73ec12d6fd req-a76abafc-1087-4fc4-af04-fe3b03c8bd71 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 210 time: 0.0956502
May 27 09:32:54.536007 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c992d40-c1b7-4876-8f38-0be228bfa0d9 req-9abcdc03-6ee8-4fbc-b0ad-e979637391aa tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:54.546485 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8c992d40-c1b7-4876-8f38-0be228bfa0d9 req-9abcdc03-6ee8-4fbc-b0ad-e979637391aa tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.2284617
May 27 09:32:54.586473 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec853190>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:50Z', 'revision_number': 3, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:54.597402 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-850ebac3-633b-43ce-af5b-2b5de2d1c1a9 None None] The sync data for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi is: [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:50Z', 'revision_number': 3, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:53Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:32:54.607803 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:54.619864 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8c992d40-c1b7-4876-8f38-0be228bfa0d9 req-ddaf7b44-725f-4732-a305-07dc8093ccf1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0694973
May 27 09:32:54.640230 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:54.647545 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f255636e-07cf-4ebe-a22e-d6b32859f1f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:54.718937 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21618224-7a3d-48c8-b188-4558175a693c req-9fd47d52-5fd7-4979-989d-444f5d1511d7 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:54.721117 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-21618224-7a3d-48c8-b188-4558175a693c req-9fd47d52-5fd7-4979-989d-444f5d1511d7 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 944 time: 0.0972590
May 27 09:32:54.772137 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Pushing event updated for resources: {'SecurityGroup': ['ID=54cad300-eedf-4e53-bf20-56c36236c185,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:54.774340 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-21618224-7a3d-48c8-b188-4558175a693c req-0ffd890a-da76-4ba8-a1f3-caf5fe764163 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0468891
May 27 09:32:54.775486 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:54.785564 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:54.822927 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Transition to ACTIVE for port object 5b3c7db8-4288-45a7-a18e-484e4c69dfbb will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:54.936160 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Allocated IP 192.168.233.242 (046de037-2aa2-4131-9293-eb7b6b5db405/e5e6c5f8-b397-4481-834c-644ad15db5e2/aa098b16-c767-480e-b777-c4ba67a185a4) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:32:54.951604 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:54.957768 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:55.050655 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Network d58a455f-cc80-4aa7-a530-ce993d4da5e4 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:32:55.064654 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:32:55.067312 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:32:55.109412 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Pushing event updated for resources: {'Port': ['ID=5b3c7db8-4288-45a7-a18e-484e4c69dfbb,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:55.112690 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:55.232273 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3816556'] for router_interface, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:55.280524 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device bd7e74f7-d502-4ed5-b38d-566afcb0be1a details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:32:55.408333 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-ca46e786-bab4-4564-bd5a-94645a37f604 None None] Provisioning for port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:32:55.478968 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:55.488182 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:55.491262 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-ca46e786-bab4-4564-bd5a-94645a37f604 None None] Provisioning complete for port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:32:55.491779 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ca46e786-bab4-4564-bd5a-94645a37f604 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:55.526856 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Transition to ACTIVE for port object aa098b16-c767-480e-b777-c4ba67a185a4 will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:55.547983 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'port_id': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'mac_address': 'fa:16:3e:45:6e:69', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 396, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:32:55.650373 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:55.662195 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d3931abd-beb3-4626-9254-2a7f151a353d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:55.689682 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:55.709768 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-ca46e786-bab4-4564-bd5a-94645a37f604 None None] Port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:32:55.719126 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bd7e74f7-d502-4ed5-b38d-566afcb0be1a {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:32:55.747116 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:55.754050 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:55.755027 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 524ba62d-2814-4825-b3ab-2f96c42b5a0c details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:32:55.760418 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:55.775968 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-695b8b43-084c-41f3-b50a-afb133f1b9be req-c111314c-afa6-4b1c-ad5c-4f1ee701371e tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:55.782431 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Network 046de037-2aa2-4131-9293-eb7b6b5db405 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:32:55.785454 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-695b8b43-084c-41f3-b50a-afb133f1b9be req-c111314c-afa6-4b1c-ad5c-4f1ee701371e tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 936 time: 0.1109149
May 27 09:32:55.789453 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:32:55.792246 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:32:55.834414 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Pushing event updated for resources: {'Port': ['ID=aa098b16-c767-480e-b777-c4ba67a185a4,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:55.845372 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.183s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:55.851348 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:55.856534 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-695b8b43-084c-41f3-b50a-afb133f1b9be req-442e39c8-ec7f-42fd-84c5-e7889ad3e99b tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0698609
May 27 09:32:55.998538 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:55.999826 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.041851 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:56.058043 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:56.062390 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 938 time: 2.2999403
May 27 09:32:56.090188 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Request body: {'port': {'device_id': '6757e96f-c173-47bc-ba37-1fc4e9b0347d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:56.187874 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 524ba62d-2814-4825-b3ab-2f96c42b5a0c, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=524ba62d-2814-4825-b3ab-2f96c42b5a0c,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:56.197684 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436d99b2-93e0-4023-b144-d29555e370ab req-3a723dd0-409d-4f5b-9ce5-ff804d06c476 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:56.204183 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-436d99b2-93e0-4023-b144-d29555e370ab req-3a723dd0-409d-4f5b-9ce5-ff804d06c476 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 944 time: 0.1892924
May 27 09:32:56.212963 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '524ba62d-2814-4825-b3ab-2f96c42b5a0c', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'port_id': '524ba62d-2814-4825-b3ab-2f96c42b5a0c', 'mac_address': 'fa:16:3e:21:83:26', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 399, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:32:56.213230 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd6ae571-2354-45e7-88af-10f0aec8a9f4 req-5db84115-421e-4129-a287-d3887cdfd826 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:56.215166 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fd6ae571-2354-45e7-88af-10f0aec8a9f4 req-5db84115-421e-4129-a287-d3887cdfd826 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 944 time: 0.2733994
May 27 09:32:56.308668 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-436d99b2-93e0-4023-b144-d29555e370ab req-52e0b685-fa92-446b-8b88-9b7286a07f52 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0924389
May 27 09:32:56.315123 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fd6ae571-2354-45e7-88af-10f0aec8a9f4 req-127f8fc4-5679-4af4-822c-918eed0fb7bd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0737140
May 27 09:32:56.334519 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-62e55579-ebcd-417d-86e3-a3089f1219e6 None None] Provisioning for port aa098b16-c767-480e-b777-c4ba67a185a4 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:32:56.353436 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.371704 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-62e55579-ebcd-417d-86e3-a3089f1219e6 None None] Provisioning complete for port aa098b16-c767-480e-b777-c4ba67a185a4 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:32:56.372095 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-62e55579-ebcd-417d-86e3-a3089f1219e6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.428404 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.438989 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 8c399902-7a66-4c08-a29d-47eb71f37136 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:32:56.503411 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 524ba62d-2814-4825-b3ab-2f96c42b5a0c {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:32:56.526367 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.533516 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-62e55579-ebcd-417d-86e3-a3089f1219e6 None None] Port aa098b16-c767-480e-b777-c4ba67a185a4 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:32:56.538799 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 524ba62d-2814-4825-b3ab-2f96c42b5a0c, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=524ba62d-2814-4825-b3ab-2f96c42b5a0c,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:56.546089 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.548719 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:56.621542 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 8c399902-7a66-4c08-a29d-47eb71f37136 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:32:56.633363 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 8c399902-7a66-4c08-a29d-47eb71f37136 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:32:56.633741 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.647184 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.660526 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.682797 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=524ba62d-2814-4825-b3ab-2f96c42b5a0c,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:56.688370 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:56.697565 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-696d11c6-d0f4-4209-b365-a2705a433471 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:56.805362 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.823714 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 8c399902-7a66-4c08-a29d-47eb71f37136, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=8c399902-7a66-4c08-a29d-47eb71f37136,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:32:56.829636 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.831512 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:56.840309 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3683833', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3816655'] for router_interface, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:56.873566 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Pushing event updated for resources: {'Port': ['ID=5b3c7db8-4288-45a7-a18e-484e4c69dfbb,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:56.900692 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:56.908177 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=8c399902-7a66-4c08-a29d-47eb71f37136,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:56.913131 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:57.065425 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641563d0-c64c-44a6-9ad0-3c983797ce3a req-7b4d4592-5d9c-443d-9eb8-c658b1f7c83e tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:57.067303 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-641563d0-c64c-44a6-9ad0-3c983797ce3a req-7b4d4592-5d9c-443d-9eb8-c658b1f7c83e tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 936 time: 0.0995586
May 27 09:32:57.114250 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-641563d0-c64c-44a6-9ad0-3c983797ce3a req-3d788b32-af04-4946-a7cd-cd2c297b5cf1 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0409839
May 27 09:32:57.119806 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Network d58a455f-cc80-4aa7-a530-ce993d4da5e4 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:32:57.122194 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:32:57.336579 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id aa098b16-c767-480e-b777-c4ba67a185a4 {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:32:57.372782 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:57.373450 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-ac288b45-4a6a-4d11-891f-aa5d3a0d93de None None] Provisioning complete for port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:32:57.374375 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ac288b45-4a6a-4d11-891f-aa5d3a0d93de None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:57.402887 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Transition to ACTIVE for port object aa098b16-c767-480e-b777-c4ba67a185a4 will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:57.413332 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:57.427478 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:57.456263 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-ac288b45-4a6a-4d11-891f-aa5d3a0d93de None None] Port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:32:57.471468 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:32:57.617265 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c116998-9dac-4f4a-93b6-454467805d0d req-b6fd3009-0334-460a-9428-0fb0f42cf906 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:57.619073 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6c116998-9dac-4f4a-93b6-454467805d0d req-b6fd3009-0334-460a-9428-0fb0f42cf906 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 944 time: 0.1166320
May 27 09:32:57.631499 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cb80c58-6f65-4fbf-9197-4afc36e0848f req-0691030d-11a8-4b20-a351-9a2f4e7a0e2f tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:57.633301 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8cb80c58-6f65-4fbf-9197-4afc36e0848f req-0691030d-11a8-4b20-a351-9a2f4e7a0e2f tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 945 time: 0.1759837
May 27 09:32:57.664411 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Pushing event updated for resources: {'Port': ['ID=aa098b16-c767-480e-b777-c4ba67a185a4,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:57.711816 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6c116998-9dac-4f4a-93b6-454467805d0d req-b21fbaaa-415b-46e9-8fdf-dc7bb3d1bdf9 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0773003
May 27 09:32:57.716493 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:57.720572 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8cb80c58-6f65-4fbf-9197-4afc36e0848f req-00bedef4-802b-4b00-bd0e-bd832da5a0e7 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0703847
May 27 09:32:57.850330 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Attempting to bind port aa098b16-c767-480e-b777-c4ba67a185a4 on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:32:57.850664 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Attempting to bind port aa098b16-c767-480e-b777-c4ba67a185a4 by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': 'ff06cfec-4c84-4b3f-8844-ab24b7be9cca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:32:57.850989 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Attempting to bind port aa098b16-c767-480e-b777-c4ba67a185a4 on network 046de037-2aa2-4131-9293-eb7b6b5db405 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:32:57.863101 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Port aa098b16-c767-480e-b777-c4ba67a185a4 on network 046de037-2aa2-4131-9293-eb7b6b5db405 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:32:57.863452 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Attempting to bind port aa098b16-c767-480e-b777-c4ba67a185a4 on network 046de037-2aa2-4131-9293-eb7b6b5db405 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:32:57.872796 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 32, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:32:57.873160 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Checking segment: {'id': 'ff06cfec-4c84-4b3f-8844-ab24b7be9cca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:32:57.873657 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Bound using segment: {'id': 'ff06cfec-4c84-4b3f-8844-ab24b7be9cca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:32:57.874444 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Bound port: aa098b16-c767-480e-b777-c4ba67a185a4, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'ff06cfec-4c84-4b3f-8844-ab24b7be9cca', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 390, 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:32:57.874712 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:57.885558 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:32:57.891609 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] 10.222.0.30 "PUT /v2.0/routers/3fbfa78b-08d5-463c-a8ae-78ec8a0d8662/add_router_interface HTTP/1.1" status: 200  len: 503 time: 5.1981919
May 27 09:32:57.903783 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Sync routers for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:32:57.923583 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:32:57.924740 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eeda36cd0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:58.033265 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] For port aa098b16-c767-480e-b777-c4ba67a185a4, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:32:58.038804 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] For port aa098b16-c767-480e-b777-c4ba67a185a4, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=aa098b16-c767-480e-b777-c4ba67a185a4,segment=NetworkSegment(ff06cfec-4c84-4b3f-8844-ab24b7be9cca),segment_id=ff06cfec-4c84-4b3f-8844-ab24b7be9cca)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:32:58.044948 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:58.053133 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:58.143795 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:58.145102 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:58.147271 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] 10.222.0.11 "PUT /v2.0/ports/aa098b16-c767-480e-b777-c4ba67a185a4 HTTP/1.1" status: 200  len: 1098 time: 2.0778317
May 27 09:32:58.148018 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6757e96f-c173-47bc-ba37-1fc4e9b0347d', 'tag': 'aa098b16-c767-480e-b777-c4ba67a185a4'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:32:58.181738 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:32:58.189244 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Pushing event updated for resources: {'Port': ['ID=aa098b16-c767-480e-b777-c4ba67a185a4,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:58.193495 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:58.213630 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6757e96f-c173-47bc-ba37-1fc4e9b0347d', 'tag': 'aa098b16-c767-480e-b777-c4ba67a185a4', 'status': 'completed', 'code': 200}
May 27 09:32:58.338580 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 8c399902-7a66-4c08-a29d-47eb71f37136 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:32:58.402065 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2839fdeb-39c5-4ef8-8055-15344811a265 req-b36af96a-af11-45de-a897-db658a4804e9 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:58.408491 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2839fdeb-39c5-4ef8-8055-15344811a265 req-b36af96a-af11-45de-a897-db658a4804e9 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 948 time: 0.1290197
May 27 09:32:58.505389 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2839fdeb-39c5-4ef8-8055-15344811a265 req-183ac45a-cf2b-4d7a-a4af-75f225de7b17 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0905011
May 27 09:32:58.515696 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 8c399902-7a66-4c08-a29d-47eb71f37136 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:32:58.516256 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:58.680343 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eeda36cd0>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 2, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:32:58.685238 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Checking router: 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:32:58.685710 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Updating router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb binding host dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:32:58.710479 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54586) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:58.716532 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-667651670-network', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:58.722674 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:58.727219 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Usage tracker for resource:network and tenant:84f0499276a14bb58311b0634f9b1dde is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:58.730696 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:58.737878 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:58.746338 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:58.751960 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Made reservation on behalf of 84f0499276a14bb58311b0634f9b1dde for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:32:58.755730 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:58.783762 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:58.815148 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:58.821953 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Usage tracker for resource:security_group_rule and tenant:84f0499276a14bb58311b0634f9b1dde is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:58.829165 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:58.839815 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:58.987882 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:58.993127 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:58.997314 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:59.030074 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] vlan segment allocate from pool success with {'vlan_id': 375, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:32:59.040140 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b14b983e-0cd2-48a1-ae8a-328d9ce4f2c0,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:59.051938 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:59.058739 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:59.059933 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Added segment 0830e60f-fb48-48f7-a89b-adcde111560d of type vlan for network 59236645-74b3-4245-96bc-3faea65c95e6
May 27 09:32:59.068462 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a6f210-4ee5-4771-951b-1ce664bf8899 req-9e1f8876-5218-46e7-a016-09b86a815eb9 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:59.070138 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e8a6f210-4ee5-4771-951b-1ce664bf8899 req-9e1f8876-5218-46e7-a016-09b86a815eb9 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 944 time: 0.1973708
May 27 09:32:59.109449 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:59.110393 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6958bc-e7e9-4481-81df-db1e26cd8e8d req-7012eee0-868d-4ab2-9cb4-b5ccf1b01e16 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:59.111967 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4a6958bc-e7e9-4481-81df-db1e26cd8e8d req-7012eee0-868d-4ab2-9cb4-b5ccf1b01e16 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 945 time: 0.1380403
May 27 09:32:59.158876 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e8a6f210-4ee5-4771-951b-1ce664bf8899 req-f6a6efdf-d311-432a-9f9d-e4e276055714 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0771987
May 27 09:32:59.177360 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:59.180139 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:59.181409 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:59.189118 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4a6958bc-e7e9-4481-81df-db1e26cd8e8d req-86e1f121-1112-4c07-b376-de7b9501c38c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0656807
May 27 09:32:59.194206 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:59.236693 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Notify callbacks [] for port, precommit_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:59.249681 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.provisioning_blocks [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Transition to ACTIVE for port object 5b3c7db8-4288-45a7-a18e-484e4c69dfbb will not be triggered until provisioned by entity L2. {{(pid=91823) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:32:59.262316 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:59.268045 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:59.448606 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 884 time: 0.7368555
May 27 09:32:59.453257 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54596) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:32:59.464323 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Request body: {'subnet': {'network_id': '59236645-74b3-4245-96bc-3faea65c95e6', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-667651670-subnet', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'ip_version': 4}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:32:59.482464 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Pushing event updated for resources: {'Port': ['ID=5b3c7db8-4288-45a7-a18e-484e4c69dfbb,revision_number=3']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:59.485154 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:32:59.507488 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Usage tracker for resource:subnet and tenant:84f0499276a14bb58311b0634f9b1dde is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:32:59.518631 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:32:59.538650 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Pushing event updated for resources: {'Network': ['ID=59236645-74b3-4245-96bc-3faea65c95e6,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:32:59.539220 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:32:59.544394 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.349s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:59.551843 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 59236645-74b3-4245-96bc-3faea65c95e6 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:32:59.564831 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.565221 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.565682 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.565810 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.566136 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.566463 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.566782 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.567114 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.567464 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.567785 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.568144 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.568442 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:32:59.574881 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Made reservation on behalf of 84f0499276a14bb58311b0634f9b1dde for: {'subnet': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:32:59.579200 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2399631'] for subnet, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:59.584275 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.316s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:32:59.614298 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d831981-5462-4845-9e85-3d63653818d8 req-36d542b8-d19f-434c-a75a-bcbb8cb7b292 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:59.617005 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-9d831981-5462-4845-9e85-3d63653818d8 req-36d542b8-d19f-434c-a75a-bcbb8cb7b292 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=46febd5e53624a3cb1c861af3e9c8d61&device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 1101 time: 0.1602769
May 27 09:32:59.626679 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Attempting to bind port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:32:59.627062 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Attempting to bind port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:32:59.627948 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Attempting to bind port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb on network d58a455f-cc80-4aa7-a530-ce993d4da5e4 {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:32:59.635119 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 32, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:32:59.635524 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Checking segment: {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91823) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:32:59.643805 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:59.644228 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Bound using segment: {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:32:59.644750 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Bound port: 5b3c7db8-4288-45a7-a18e-484e4c69dfbb, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'}}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:32:59.645132 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:59.664682 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-9d831981-5462-4845-9e85-3d63653818d8 req-61d1407f-9fbe-4590-8b40-279684499078 service neutron] 10.222.0.11 "GET /v2.0/networks?tenant_id=46febd5e53624a3cb1c861af3e9c8d61&shared=False HTTP/1.1" status: 200  len: 213 time: 0.0335886
May 27 09:32:59.711660 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['bd7e74f7-d502-4ed5-b38d-566afcb0be1a'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:32:59.760254 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['524ba62d-2814-4825-b3ab-2f96c42b5a0c'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:32:59.805354 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] For port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91823) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:32:59.811103 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] For port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=5b3c7db8-4288-45a7-a18e-484e4c69dfbb,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91823) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:32:59.818084 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:32:59.823934 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19061876-e45a-4abd-9712-bcb462250110 req-b236e0d3-a371-4078-83d0-70cb43444443 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:59.825847 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-19061876-e45a-4abd-9712-bcb462250110 req-b236e0d3-a371-4078-83d0-70cb43444443 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 948 time: 0.1082735
May 27 09:32:59.830020 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:32:59.872437 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d831981-5462-4845-9e85-3d63653818d8 req-82b6f940-5221-4de1-b063-ebdd84c5f572 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:32:59.878495 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-9d831981-5462-4845-9e85-3d63653818d8 req-82b6f940-5221-4de1-b063-ebdd84c5f572 service neutron] 10.222.0.11 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200  len: 870 time: 0.2051980
May 27 09:32:59.927820 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:32:59.928617 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eeda36cd0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:00.043247 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-c669acf5-22e9-4d87-982b-7f1e27c0940c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:00.045195 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-c669acf5-22e9-4d87-982b-7f1e27c0940c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=46febd5e53624a3cb1c861af3e9c8d61&device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 1101 time: 0.1245778
May 27 09:33:00.078267 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-19061876-e45a-4abd-9712-bcb462250110 req-96779f72-2844-4a9d-8980-f7d491ad808f tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2440021
May 27 09:33:00.149864 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Pushing event updated for resources: {'Port': ['ID=5b3c7db8-4288-45a7-a18e-484e4c69dfbb,revision_number=4']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:00.164217 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-683dcde5-6e5a-439b-a748-a848e7ed0a59 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.335s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:00.189910 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-d541477c-73dd-4b90-b817-9474dafcbf74 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.242&port_id=aa098b16-c767-480e-b777-c4ba67a185a4 HTTP/1.1" status: 200  len: 217 time: 0.1320271
May 27 09:33:00.246753 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:33:00.332780 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-01baeeae-4302-4916-9b6b-9c5fc774dced service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:00.340763 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-01baeeae-4302-4916-9b6b-9c5fc774dced service neutron] 10.222.0.11 "GET /v2.0/subnets?id=e5e6c5f8-b397-4481-834c-644ad15db5e2 HTTP/1.1" status: 200  len: 843 time: 0.1402447
May 27 09:33:00.445626 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-b3b278db-98a9-47e0-95c4-4ed785df8ee9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:00.447469 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-b3b278db-98a9-47e0-95c4-4ed785df8ee9 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=046de037-2aa2-4131-9293-eb7b6b5db405&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1178 time: 0.1027591
May 27 09:33:00.547861 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2157992', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2399641'] for subnet, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:00.563916 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-05803c1c-c622-456a-8cc9-475e2daa2c4d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:00.634351 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e4136c87-14f9-437e-ad77-15645c706d7f,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:00.648480 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:00.665386 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-b89ad759-4ead-443e-8298-ac0e4be513a9 service neutron] 10.222.0.11 "GET /v2.0/networks/046de037-2aa2-4131-9293-eb7b6b5db405?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2098277
May 27 09:33:00.674808 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eeda36cd0>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:32:59Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:00.683477 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd5588e-5b21-4804-bcf4-e6a74b0cc036 None None] The sync data for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi is: [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:32:59Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:33:00.689803 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dae6897-a39a-4a08-8d60-9ca96674a8bb req-e4cc5547-8f59-4979-b7ef-80f4c440110a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:00.689991 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8dae6897-a39a-4a08-8d60-9ca96674a8bb req-e4cc5547-8f59-4979-b7ef-80f4c440110a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 944 time: 0.3015745
May 27 09:33:00.704758 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb64d64-0cd7-4dfc-a80b-e1bcb3eb0ae0 req-37ebc56c-d90f-4bf0-ab6e-5da61fac9c6b tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:00.706897 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9fb64d64-0cd7-4dfc-a80b-e1bcb3eb0ae0 req-37ebc56c-d90f-4bf0-ab6e-5da61fac9c6b tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 945 time: 0.3270164
May 27 09:33:00.824214 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Checking segment: {'id': '0830e60f-fb48-48f7-a89b-adcde111560d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:33:00.824584 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Network hostable DHCP agents. Network: 59236645-74b3-4245-96bc-3faea65c95e6, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91821) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:33:00.856834 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-d6a054a3-c370-4fe9-a23f-6f0b5cd79964 req-9c5e3adb-9f4e-4c6a-aee8-b65e1383f48e service neutron] 10.222.0.11 "GET /v2.0/networks/046de037-2aa2-4131-9293-eb7b6b5db405?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1787088
May 27 09:33:00.873143 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8dae6897-a39a-4a08-8d60-9ca96674a8bb req-4ba30e1f-84ac-4037-a32f-2b43eba45138 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1650963
May 27 09:33:00.896202 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9fb64d64-0cd7-4dfc-a80b-e1bcb3eb0ae0 req-d51dc5c3-a467-439a-88f9-0b36f4028696 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1102293
May 27 09:33:00.929533 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Network 59236645-74b3-4245-96bc-3faea65c95e6 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91821) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:33:00.951025 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 59236645-74b3-4245-96bc-3faea65c95e6) {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:33:00.961737 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:00.962598 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:00.965020 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2856d56b-4d49-4a82-bf28-e05dc68e63a0 None None] Network 59236645-74b3-4245-96bc-3faea65c95e6 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:33:00.994053 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-15c41337-6505-43dc-9290-aba3d65ce981 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 847 time: 1.5355487
May 27 09:33:00.994616 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54610) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:01.001624 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-667651670-router', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:01.007756 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:33:01.012950 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Usage tracker for resource:router and tenant:84f0499276a14bb58311b0634f9b1dde is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:33:01.018554 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:33:01.040572 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:33:01.059234 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3812772', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1963'] for router, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:01.060694 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3855012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3811180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3881146', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1952'] for router, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:01.082107 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:01.255220 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp391d76a4-97d4-5c01-84fd-9bc405269bae-59236645-74b3-4245-96bc-3faea65c95e6', 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'fixed_ips': [{'subnet_id': 'e4136c87-14f9-437e-ad77-15645c706d7f'}]}} from dv-cinder-772623-6-iscsi. {{(pid=91822) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 27 09:33:01.257430 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:01.339859 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69e029b2-07fb-44f2-9663-c4f8e3c61dca req-65b6e8d8-9bc7-4de4-a4ff-cd1c6c0b6407 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:01.342479 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69e029b2-07fb-44f2-9663-c4f8e3c61dca req-65b6e8d8-9bc7-4de4-a4ff-cd1c6c0b6407 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 948 time: 0.1331306
May 27 09:33:01.433083 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69e029b2-07fb-44f2-9663-c4f8e3c61dca req-e221567e-b58e-46d1-94dd-cbc03b101860 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0818093
May 27 09:33:01.488045 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3811195', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3812794', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2006'] for router, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:01.523503 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.db_base_plugin_common [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Allocated IP 172.20.0.2 (59236645-74b3-4245-96bc-3faea65c95e6/e4136c87-14f9-437e-ad77-15645c706d7f/500f45f3-3886-4110-8b1f-acee6fc33332) {{(pid=91822) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:33:01.780839 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Notify callbacks [] for port, precommit_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:01.793114 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Transition to ACTIVE for port object 500f45f3-3886-4110-8b1f-acee6fc33332 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:33:01.818974 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Transition to ACTIVE for port object 500f45f3-3886-4110-8b1f-acee6fc33332 will not be triggered until provisioned by entity DHCP. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:33:01.828166 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:01.832269 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:01.923730 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Network 59236645-74b3-4245-96bc-3faea65c95e6 is already hosted by enough agents. {{(pid=91822) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:33:01.927546 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.base_scheduler [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Resources bound (agent type, host, resource id):  {{(pid=91822) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:33:01.931017 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Received port after_create {{(pid=91822) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:33:01.969696 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:01.986421 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Pushing event updated for resources: {'Port': ['ID=500f45f3-3886-4110-8b1f-acee6fc33332,revision_number=1']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:01.989970 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.158s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:02.026419 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:02.047639 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Attempting to bind port 500f45f3-3886-4110-8b1f-acee6fc33332 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:33:02.048028 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Attempting to bind port 500f45f3-3886-4110-8b1f-acee6fc33332 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '0830e60f-fb48-48f7-a89b-adcde111560d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:33:02.048397 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Attempting to bind port 500f45f3-3886-4110-8b1f-acee6fc33332 on network 59236645-74b3-4245-96bc-3faea65c95e6 {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:33:02.054767 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 32, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:33:02.055061 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Checking segment: {'id': '0830e60f-fb48-48f7-a89b-adcde111560d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:33:02.055574 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:02.055988 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Bound using segment: {'id': '0830e60f-fb48-48f7-a89b-adcde111560d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:33:02.056519 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Bound port: 500f45f3-3886-4110-8b1f-acee6fc33332, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0830e60f-fb48-48f7-a89b-adcde111560d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:33:02.056946 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:02.227626 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-161652eb-4798-49b5-bc20-728e3c2b9eba req-05b028d4-da65-4efb-90e4-df9736e44cba tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:02.228694 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Allocated IP 172.27.1.159 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/5d050986-7f7e-4195-a5af-217efc53ed28) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:33:02.236199 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-161652eb-4798-49b5-bc20-728e3c2b9eba req-05b028d4-da65-4efb-90e4-df9736e44cba tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 944 time: 0.1824379
May 27 09:33:02.244114 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] For port 500f45f3-3886-4110-8b1f-acee6fc33332, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:33:02.247983 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] For port 500f45f3-3886-4110-8b1f-acee6fc33332, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=500f45f3-3886-4110-8b1f-acee6fc33332,segment=NetworkSegment(0830e60f-fb48-48f7-a89b-adcde111560d),segment_id=0830e60f-fb48-48f7-a89b-adcde111560d)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:33:02.253684 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:02.262662 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:02.285862 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51170b48-3ee3-4cbf-8af7-fe5364e09080 req-03a8d976-8cf5-482b-811f-a6de442d0b9f tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:02.289270 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-51170b48-3ee3-4cbf-8af7-fe5364e09080 req-03a8d976-8cf5-482b-811f-a6de442d0b9f tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 945 time: 0.1904185
May 27 09:33:02.358234 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device bd7e74f7-d502-4ed5-b38d-566afcb0be1a up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:02.368909 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-161652eb-4798-49b5-bc20-728e3c2b9eba req-396f9b49-5996-45c7-b1b0-301b0eea5fdc tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1315613
May 27 09:33:02.401921 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-51170b48-3ee3-4cbf-8af7-fe5364e09080 req-6a2deafb-af9e-4a9c-b1ee-13aa8ff1932b tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1114366
May 27 09:33:02.438223 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Pushing event updated for resources: {'Port': ['ID=500f45f3-3886-4110-8b1f-acee6fc33332,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:02.446513 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 5b3c7db8-4288-45a7-a18e-484e4c69dfbb up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:02.518036 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:02.562562 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port bd7e74f7-d502-4ed5-b38d-566afcb0be1a completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:33:02.564303 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:02.569243 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port bd7e74f7-d502-4ed5-b38d-566afcb0be1a triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:02.569636 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:02.610839 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:02.627068 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2b379039-ced7-4ea2-9beb-ffe4ad4530bf tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:02.635722 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:33:02.671471 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:02.672238 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:02.739968 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:33:02.743912 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:33:02.760648 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:33:02.765575 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d355cdde-d0f7-42e4-83c1-70f49bd5a735 req-0bcd6922-917b-49db-af49-ef9ff72b66fb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:02.767434 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d355cdde-d0f7-42e4-83c1-70f49bd5a735 req-0bcd6922-917b-49db-af49-ef9ff72b66fb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 948 time: 0.1911685
May 27 09:33:02.823005 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Pushing event updated for resources: {'Port': ['ID=5d050986-7f7e-4195-a5af-217efc53ed28,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:02.828863 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:02.842737 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d355cdde-d0f7-42e4-83c1-70f49bd5a735 req-c8928fed-16d9-41ee-bb58-368a0530ab67 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0651746
May 27 09:33:02.874393 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:02.949167 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:33:02.966274 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:02.976659 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:02.988254 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:02.989111 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 524ba62d-2814-4825-b3ab-2f96c42b5a0c up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:03.021208 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:03.132338 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=5b3c7db8-4288-45a7-a18e-484e4c69dfbb,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:03.140284 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:03.146499 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:03.150270 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:03.150732 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.006s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:03.223416 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 524ba62d-2814-4825-b3ab-2f96c42b5a0c completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:33:03.241022 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 524ba62d-2814-4825-b3ab-2f96c42b5a0c triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:03.241609 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:03.272769 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:03.330630 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=5b3c7db8-4288-45a7-a18e-484e4c69dfbb,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:03.334577 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:03.359683 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'code': 200}
May 27 09:33:03.425557 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:03.495859 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 524ba62d-2814-4825-b3ab-2f96c42b5a0c, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=524ba62d-2814-4825-b3ab-2f96c42b5a0c,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:03.504634 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:03.510581 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-bd9f11d7-45de-4df9-b91a-0e20a1375120 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:03.645524 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=524ba62d-2814-4825-b3ab-2f96c42b5a0c,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:03.658576 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:03.711190 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0f1eb10-7896-41b1-b1f3-fb959f6744f4 req-311edfc8-b7b4-4c5b-bb1a-aa5bfed48bc0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:03.714792 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a0f1eb10-7896-41b1-b1f3-fb959f6744f4 req-311edfc8-b7b4-4c5b-bb1a-aa5bfed48bc0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 946 time: 0.1665165
May 27 09:33:03.730954 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03260100-5c74-457a-a07d-f09ad11c9dfa req-fd2e26fd-dc91-42c6-98ee-1888bb434c4e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:03.733785 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-03260100-5c74-457a-a07d-f09ad11c9dfa req-fd2e26fd-dc91-42c6-98ee-1888bb434c4e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.1391160
May 27 09:33:03.752596 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc73a6b1-fc77-4be8-8482-9123878b5810 None None] Network 59236645-74b3-4245-96bc-3faea65c95e6 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:33:03.796264 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3812787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3811082'] for router, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:03.805188 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a0f1eb10-7896-41b1-b1f3-fb959f6744f4 req-be85713e-051c-4772-b15c-1a31177affee tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0845721
May 27 09:33:03.814364 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-03260100-5c74-457a-a07d-f09ad11c9dfa req-7b86ea25-fd03-4b07-b663-d603bbc142f6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0673902
May 27 09:33:03.857279 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-32b83ca0-7db2-442f-a044-c8ca72eac1c6 None None] Provisioning for port 500f45f3-3886-4110-8b1f-acee6fc33332 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:33:04.068479 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b9bc34-71f7-4ec3-8543-4f814b97c80b req-3e98a1cf-190e-4874-a0c1-e833f9dc531b tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:04.070292 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d4b9bc34-71f7-4ec3-8543-4f814b97c80b req-3e98a1cf-190e-4874-a0c1-e833f9dc531b tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 948 time: 0.0907688
May 27 09:33:04.128428 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d4b9bc34-71f7-4ec3-8543-4f814b97c80b req-485dc849-8094-40a2-ba2c-561768601c6c tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0491099
May 27 09:33:04.158350 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc is scheduled to L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 with binding_index 1 {{(pid=91820) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 27 09:33:04.352370 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:33:04.364337 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Sync routers for ids ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:33:04.376325 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Routers {'5b0cc38b-30b3-45d8-9de5-a137ad6395cc'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:33:04.376971 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec9561f0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:04.381165 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Notify callbacks [] for router, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:04.385432 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54640) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:04.387094 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201  len: 923 time: 3.3910673
May 27 09:33:04.474720 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 5b3c7db8-4288-45a7-a18e-484e4c69dfbb up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:04.559278 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ea48973-4fb0-4cea-aca7-3ca523912dfb req-59ead1c2-1a32-44a0-9a75-ec4b8372cd8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:04.560709 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3ea48973-4fb0-4cea-aca7-3ca523912dfb req-59ead1c2-1a32-44a0-9a75-ec4b8372cd8a service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 1098 time: 0.0805125
May 27 09:33:04.627399 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-3ea48973-4fb0-4cea-aca7-3ca523912dfb req-9f0f908c-e040-4967-9907-e5a1f4bc9e30 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0527170
May 27 09:33:04.645719 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:04.646103 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:04.681224 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Set router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:33:05.061995 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 500f45f3-3886-4110-8b1f-acee6fc33332 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:05.153073 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 500f45f3-3886-4110-8b1f-acee6fc33332 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:33:05.161287 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 500f45f3-3886-4110-8b1f-acee6fc33332 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:05.161665 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:05.195606 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec9561f0>, [{'id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'name': 'tempest-TestVolumeBootPattern-667651670-router', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159'}], 'enable_snat': True}, 'gw_port_id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:33:01Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 3, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'gw_port': {'id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:7f:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:33:02Z', 'updated_at': '2021-05-27T09:33:02Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:05.216488 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Checking router: 5b0cc38b-30b3-45d8-9de5-a137ad6395cc for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:33:05.216873 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Updating router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc port 5d050986-7f7e-4195-a5af-217efc53ed28 binding host dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:33:05.282612 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:05.347564 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc3ed4b7-e1cb-489b-af12-72f671ecd1e9 req-9d40cb85-31d3-4689-90ef-21e8894cdb06 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:05.349145 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dc3ed4b7-e1cb-489b-af12-72f671ecd1e9 req-9d40cb85-31d3-4689-90ef-21e8894cdb06 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.3864770
May 27 09:33:05.361566 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '524ba62d-2814-4825-b3ab-2f96c42b5a0c'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:33:05.362458 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f008c043-4c23-4bfc-b85b-a5ce706e5659 req-672e9cf9-f053-41f8-a70b-6c30a7870302 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:05.364478 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f008c043-4c23-4bfc-b85b-a5ce706e5659 req-672e9cf9-f053-41f8-a70b-6c30a7870302 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 946 time: 0.3634021
May 27 09:33:05.453510 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:05.527618 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 500f45f3-3886-4110-8b1f-acee6fc33332, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=500f45f3-3886-4110-8b1f-acee6fc33332,segment=NetworkSegment(0830e60f-fb48-48f7-a89b-adcde111560d),segment_id=0830e60f-fb48-48f7-a89b-adcde111560d)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:05.570790 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:05.578691 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:05.580263 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dc3ed4b7-e1cb-489b-af12-72f671ecd1e9 req-963797a1-41a4-40f2-87b8-360fd72d0001 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.2109127
May 27 09:33:05.704246 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f008c043-4c23-4bfc-b85b-a5ce706e5659 req-a71339cb-f84f-49d2-b6eb-73a2cc813ef7 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.3081982
May 27 09:33:05.734693 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=500f45f3-3886-4110-8b1f-acee6fc33332,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:05.755056 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:05.817008 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '524ba62d-2814-4825-b3ab-2f96c42b5a0c', 'code': 200}
May 27 09:33:05.838332 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:05.894912 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Notify callbacks [] for port, precommit_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:05.909066 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Transition to ACTIVE for port object 5d050986-7f7e-4195-a5af-217efc53ed28 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:33:05.917456 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:05.921393 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:06.005347 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Attempting to bind port 5d050986-7f7e-4195-a5af-217efc53ed28 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:33:06.005778 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Attempting to bind port 5d050986-7f7e-4195-a5af-217efc53ed28 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:33:06.006096 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Attempting to bind port 5d050986-7f7e-4195-a5af-217efc53ed28 on network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:33:06.008454 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30aa56e-48df-4910-a11f-b45f4a030c23 None None] Pushing event updated for resources: {'Port': ['ID=5d050986-7f7e-4195-a5af-217efc53ed28,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:06.012565 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-c30aa56e-48df-4910-a11f-b45f4a030c23 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:06.016729 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 32, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:33:06.016729 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Checking segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:33:06.016729 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:06.017183 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Bound using segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:33:06.017694 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Bound port: 5d050986-7f7e-4195-a5af-217efc53ed28, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:33:06.018080 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:06.100292 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:33:06.108855 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] For port 5d050986-7f7e-4195-a5af-217efc53ed28, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:33:06.112522 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] For port 5d050986-7f7e-4195-a5af-217efc53ed28, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=5d050986-7f7e-4195-a5af-217efc53ed28,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:33:06.117989 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:06.121765 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-e99b9186-70e0-461b-86fa-aa194a5b31f1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:06.136670 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfab611d-565e-4825-9839-082cd7e9f590 req-ce8d177b-4b26-4b29-93a2-c98398137bd0 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:06.138171 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bfab611d-565e-4825-9839-082cd7e9f590 req-ce8d177b-4b26-4b29-93a2-c98398137bd0 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 948 time: 0.2574666
May 27 09:33:06.151119 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1836e6d-e393-446a-950e-6c2c120887d3 req-d546f3fd-090d-45e2-8b30-a42a69cbb406 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:06.153352 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c1836e6d-e393-446a-950e-6c2c120887d3 req-d546f3fd-090d-45e2-8b30-a42a69cbb406 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 1099 time: 0.0879874
May 27 09:33:06.202447 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-c1836e6d-e393-446a-950e-6c2c120887d3 req-9ff9a1dd-5fd3-4f12-a597-141a4e3dd248 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412629
May 27 09:33:06.238991 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Routers {'5b0cc38b-30b3-45d8-9de5-a137ad6395cc'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:33:06.240019 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec9561f0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:06.249852 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bfab611d-565e-4825-9839-082cd7e9f590 req-870008d3-adb2-4ef9-b92e-27eea931637f tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1022048
May 27 09:33:06.262721 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Allocated IP 172.20.0.1 (59236645-74b3-4245-96bc-3faea65c95e6/e4136c87-14f9-437e-ad77-15645c706d7f/bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:33:06.333777 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30aa56e-48df-4910-a11f-b45f4a030c23 None None] Pushing event updated for resources: {'Port': ['ID=5d050986-7f7e-4195-a5af-217efc53ed28,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:06.352605 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 500f45f3-3886-4110-8b1f-acee6fc33332 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:06.411564 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-c30aa56e-48df-4910-a11f-b45f4a030c23 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:06.429420 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:06.447090 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Transition to ACTIVE for port object bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 will not be triggered until provisioned by entity DHCP. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:33:06.473951 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:06.479466 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-67a55449-400c-497f-8e24-3f734d01f5c2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:06.547463 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Network 59236645-74b3-4245-96bc-3faea65c95e6 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:33:06.551120 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:33:06.556285 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:33:06.606905 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Pushing event updated for resources: {'Port': ['ID=bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:06.613515 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:06.627942 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3816556'] for router_interface, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:06.671558 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 500f45f3-3886-4110-8b1f-acee6fc33332 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:06.672112 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:06.747179 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] Set router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:33:07.058783 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:07.094044 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51ebb154-6fad-4b1d-b34a-814f1ee2a6f7 req-cd97b8f6-b6bf-497d-8e43-df19422834a6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:07.095936 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-51ebb154-6fad-4b1d-b34a-814f1ee2a6f7 req-cd97b8f6-b6bf-497d-8e43-df19422834a6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.3369136
May 27 09:33:07.141347 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69002fd7-50d4-4f26-aa75-161aed19d186 req-42926c0c-e736-4671-9b09-b0241942896b tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:07.141655 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-0806027e-61f7-4837-b4fe-b0590c3434b5 None None] Provisioning for port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:33:07.142777 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69002fd7-50d4-4f26-aa75-161aed19d186 req-42926c0c-e736-4671-9b09-b0241942896b tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 946 time: 0.2632093
May 27 09:33:07.162012 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-0806027e-61f7-4837-b4fe-b0590c3434b5 None None] Provisioning complete for port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:07.162466 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-0806027e-61f7-4837-b4fe-b0590c3434b5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:07.251281 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-51ebb154-6fad-4b1d-b34a-814f1ee2a6f7 req-f7b758a4-259c-4704-bc7c-b467cc72352f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1257417
May 27 09:33:07.286199 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69002fd7-50d4-4f26-aa75-161aed19d186 req-f9588699-883b-4aa6-87e1-b117e12b0164 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1182799
May 27 09:33:07.401955 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-0806027e-61f7-4837-b4fe-b0590c3434b5 None None] Port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:33:07.447424 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec9561f0>, [{'id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'name': 'tempest-TestVolumeBootPattern-667651670-router', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159'}], 'enable_snat': True}, 'gw_port_id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:33:01Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 3, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'gw_port': {'id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:7f:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:33:02Z', 'updated_at': '2021-05-27T09:33:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:07.452671 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5c6a8c0-ca8f-45ad-8870-2f6e3c9de296 None None] The sync data for ids ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'] in dv-cinder-772623-6-iscsi is: [{'id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'name': 'tempest-TestVolumeBootPattern-667651670-router', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159'}], 'enable_snat': True}, 'gw_port_id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:33:01Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 3, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'gw_port': {'id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:7f:20', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:33:02Z', 'updated_at': '2021-05-27T09:33:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:33:07.500801 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device aa098b16-c767-480e-b777-c4ba67a185a4 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:33:07.674376 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port aa098b16-c767-480e-b777-c4ba67a185a4, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=aa098b16-c767-480e-b777-c4ba67a185a4,segment=NetworkSegment(ff06cfec-4c84-4b3f-8844-ab24b7be9cca),segment_id=ff06cfec-4c84-4b3f-8844-ab24b7be9cca)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:07.693385 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': 'aa098b16-c767-480e-b777-c4ba67a185a4', 'network_id': '046de037-2aa2-4131-9293-eb7b6b5db405', 'port_id': 'aa098b16-c767-480e-b777-c4ba67a185a4', 'mac_address': 'fa:16:3e:cc:3d:3d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 390, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e5e6c5f8-b397-4481-834c-644ad15db5e2', 'ip_address': '192.168.233.242'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:33:07.704081 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:07.722331 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8ba55f3-5e6e-4257-8982-0343d3fd1983 req-705b40a1-bd34-4adf-8edf-f30ea8058f79 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:07.730396 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c8ba55f3-5e6e-4257-8982-0343d3fd1983 req-705b40a1-bd34-4adf-8edf-f30ea8058f79 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 948 time: 0.2376752
May 27 09:33:07.749509 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:07.784302 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e5cc98eb-07fc-42c2-a2d9-decd2eef6eb3 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:07.804646 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:07.825579 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a77d03ed-b406-4046-b797-92d0ec07f0b5 req-6cb7f9f0-34c2-44aa-9487-d7af4cdfe935 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:07.827796 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a77d03ed-b406-4046-b797-92d0ec07f0b5 req-6cb7f9f0-34c2-44aa-9487-d7af4cdfe935 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.3364153
May 27 09:33:07.843833 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54672) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:07.852655 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-f568d3a7-a442-4fe9-a4d1-192d5feeabd0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Request body: {'floatingip': {'port_id': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:07.856657 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aa098b16-c767-480e-b777-c4ba67a185a4 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:33:07.906679 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port aa098b16-c767-480e-b777-c4ba67a185a4, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=aa098b16-c767-480e-b777-c4ba67a185a4,segment=NetworkSegment(ff06cfec-4c84-4b3f-8844-ab24b7be9cca),segment_id=ff06cfec-4c84-4b3f-8844-ab24b7be9cca)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:07.912079 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c8ba55f3-5e6e-4257-8982-0343d3fd1983 req-707fcd85-0a14-4de9-b929-779f1cc16c6b tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1803989
May 27 09:33:07.915347 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3683833', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3816655'] for router_interface, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:07.918335 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:07.927155 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:07.940754 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Pushing event updated for resources: {'Port': ['ID=bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:07.951042 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:08.012013 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f568d3a7-a442-4fe9-a4d1-192d5feeabd0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:08.083773 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=aa098b16-c767-480e-b777-c4ba67a185a4,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:08.098125 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.172s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:08.201142 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['aa098b16-c767-480e-b777-c4ba67a185a4'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:33:08.263019 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Network 59236645-74b3-4245-96bc-3faea65c95e6 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:33:08.265768 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:33:08.504952 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 5d050986-7f7e-4195-a5af-217efc53ed28 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:08.637862 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-50b47d65-eef5-4e55-9379-ca9b9c7d95f0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:08.743849 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 5d050986-7f7e-4195-a5af-217efc53ed28 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:33:08.749526 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 5d050986-7f7e-4195-a5af-217efc53ed28 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:08.749963 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:08.810957 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:33:08.896535 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-8599d477-ec5d-4a84-8ba5-4aba62c75d55 None None] Provisioning complete for port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:08.896919 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-8599d477-ec5d-4a84-8ba5-4aba62c75d55 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:08.923567 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd3e9ff4-f3e5-4b2b-bf01-84e7e4d3f542 req-3be546ca-92b2-4173-a297-a81394b8ec3c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:08.925119 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cd3e9ff4-f3e5-4b2b-bf01-84e7e4d3f542 req-3be546ca-92b2-4173-a297-a81394b8ec3c tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 946 time: 0.2981536
May 27 09:33:08.939086 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:08.973463 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 5d050986-7f7e-4195-a5af-217efc53ed28, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=5d050986-7f7e-4195-a5af-217efc53ed28,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:08.977850 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-8599d477-ec5d-4a84-8ba5-4aba62c75d55 None None] Port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:33:08.984640 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:08.988142 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:09.079320 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=5d050986-7f7e-4195-a5af-217efc53ed28,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:09.083974 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:09.103391 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cd3e9ff4-f3e5-4b2b-bf01-84e7e4d3f542 req-780b968f-5aa5-4ddf-9f1a-40ce954c2575 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1600008
May 27 09:33:09.163987 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:33:09.185473 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] 10.222.0.30 "PUT /v2.0/routers/5b0cc38b-30b3-45d8-9de5-a137ad6395cc/add_router_interface HTTP/1.1" status: 200  len: 503 time: 4.7989116
May 27 09:33:09.190417 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f568d3a7-a442-4fe9-a4d1-192d5feeabd0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:09.198961 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f568d3a7-a442-4fe9-a4d1-192d5feeabd0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:09.286668 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f29c9d85-2798-495a-bf6a-2637b72252f6 req-2029dae8-6d0c-4b4d-b886-e8200af40468 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:09.288270 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f29c9d85-2798-495a-bf6a-2637b72252f6 req-2029dae8-6d0c-4b4d-b886-e8200af40468 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 949 time: 0.1685057
May 27 09:33:09.351917 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f29c9d85-2798-495a-bf6a-2637b72252f6 req-694c10ce-72aa-48b0-903f-a121cc84b977 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0539680
May 27 09:33:09.371654 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464cac8e-e7c4-47d2-a489-5c1345016550 req-dc942467-0fe5-42e4-beca-1ddff1b253b8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:09.371654 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-464cac8e-e7c4-47d2-a489-5c1345016550 req-dc942467-0fe5-42e4-beca-1ddff1b253b8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 946 time: 0.1442671
May 27 09:33:09.376775 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 54694) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:09.382180 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-6c81e8ab-0a53-4020-9be0-7187153d2ae2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Request body: {'floatingip': {'port_id': '524ba62d-2814-4825-b3ab-2f96c42b5a0c'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:09.415127 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.l3_db [None req-f568d3a7-a442-4fe9-a4d1-192d5feeabd0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Floating IP bd184371-ce98-4013-aa95-667c89febf8f associated. External IP: 172.27.1.74, port: bd7e74f7-d502-4ed5-b38d-566afcb0be1a.
May 27 09:33:09.489094 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6c81e8ab-0a53-4020-9be0-7187153d2ae2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:09.514672 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device aa098b16-c767-480e-b777-c4ba67a185a4 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:09.676069 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port aa098b16-c767-480e-b777-c4ba67a185a4 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:33:09.681994 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port aa098b16-c767-480e-b777-c4ba67a185a4 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:09.682380 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:09.876034 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:09.909268 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6757e96f-c173-47bc-ba37-1fc4e9b0347d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa098b16-c767-480e-b777-c4ba67a185a4'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:33:09.923509 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port aa098b16-c767-480e-b777-c4ba67a185a4, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=aa098b16-c767-480e-b777-c4ba67a185a4,segment=NetworkSegment(ff06cfec-4c84-4b3f-8844-ab24b7be9cca),segment_id=ff06cfec-4c84-4b3f-8844-ab24b7be9cca)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:09.931542 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:09.941703 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:10.013465 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Sync routers for ids ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:33:10.035536 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Routers {'5b0cc38b-30b3-45d8-9de5-a137ad6395cc'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:33:10.036612 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eedaa4460>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:10.089494 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f568d3a7-a442-4fe9-a4d1-192d5feeabd0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:33:10.163327 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=aa098b16-c767-480e-b777-c4ba67a185a4,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:10.167293 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.227s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:10.195651 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54708) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:10.206850 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1951300864', 'description': 'tempest-secgroup-smoke-1951300864 description', 'project_id': 'b8df97a650014930beb6e52081be8e90'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:10.245854 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:33:10.249161 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6757e96f-c173-47bc-ba37-1fc4e9b0347d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa098b16-c767-480e-b777-c4ba67a185a4', 'code': 200}
May 27 09:33:10.272522 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:security_group and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:33:10.287586 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:33:10.366978 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:33:10.399591 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 5d050986-7f7e-4195-a5af-217efc53ed28 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:10.445235 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Set router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:33:10.475081 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f568d3a7-a442-4fe9-a4d1-192d5feeabd0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:33:10.485784 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f568d3a7-a442-4fe9-a4d1-192d5feeabd0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:10.653884 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ea214b1-6a6b-45b6-8158-26fa4bb70836 None None] Sync routers for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:33:10.721093 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ea214b1-6a6b-45b6-8158-26fa4bb70836 None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:33:10.721771 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-5ea214b1-6a6b-45b6-8158-26fa4bb70836 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecf2fbb0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:32:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:10.733770 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:10.784141 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-f568d3a7-a442-4fe9-a4d1-192d5feeabd0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "PUT /v2.0/floatingips/bd184371-ce98-4013-aa95-667c89febf8f HTTP/1.1" status: 200  len: 990 time: 2.9384458
May 27 09:33:10.787129 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:33:10.798792 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:33:10.807269 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:security_group_rule and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:33:10.811678 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:33:10.817909 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 5d050986-7f7e-4195-a5af-217efc53ed28 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:10.818438 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:10.819125 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:33:10.832244 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711732e4-1a85-4bb2-9b11-8793d776441f req-1e648803-1ae2-4cf6-a711-1d6521055e3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:10.833810 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-711732e4-1a85-4bb2-9b11-8793d776441f req-1e648803-1ae2-4cf6-a711-1d6521055e3f service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 1103 time: 0.2618017
May 27 09:33:10.853116 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6c81e8ab-0a53-4020-9be0-7187153d2ae2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:10.864167 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6c81e8ab-0a53-4020-9be0-7187153d2ae2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:10.978113 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-711732e4-1a85-4bb2-9b11-8793d776441f req-c2f88809-68e1-44d2-942e-f0fee9c9cfd7 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1256161
May 27 09:33:11.025811 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.031330 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.037533 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e0824dc9-4ad0-45d1-9545-8ac65e8914dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:11.081519 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a94cf92f-60af-4a69-b3a5-6e00b5336a11 req-202dc774-a0a7-445e-a220-77e67a5cb723 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:11.083497 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a94cf92f-60af-4a69-b3a5-6e00b5336a11 req-202dc774-a0a7-445e-a220-77e67a5cb723 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 950 time: 0.3488035
May 27 09:33:11.117433 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.l3_db [None req-6c81e8ab-0a53-4020-9be0-7187153d2ae2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Floating IP 6771cfad-a218-4624-a012-a32dc1beb21d associated. External IP: 172.27.1.212, port: 524ba62d-2814-4825-b3ab-2f96c42b5a0c.
May 27 09:33:11.124800 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'SecurityGroup': ['ID=6de72829-ee9b-4468-8f5f-92fb65675d3b,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:11.125709 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eedaa4460>, [{'id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'name': 'tempest-TestVolumeBootPattern-667651670-router', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159'}], 'enable_snat': True}, 'gw_port_id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:33:01Z', 'updated_at': '2021-05-27T09:33:06Z', 'revision_number': 4, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'gw_port': {'id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:7f:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:33:02Z', 'updated_at': '2021-05-27T09:33:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62', 'name': '', 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'mac_address': 'fa:16:3e:90:71:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': 'e4136c87-14f9-437e-ad77-15645c706d7f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:33:05Z', 'updated_at': '2021-05-27T09:33:07Z', 'revision_number': 2, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'subnets': [{'id': 'e4136c87-14f9-437e-ad77-15645c706d7f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:11.131187 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.135814 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.9388418
May 27 09:33:11.140472 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-feb00ca6-8369-4e46-ae7f-ca71b44c5289 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:11.140690 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54720) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:11.143265 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Checking router: 5b0cc38b-30b3-45d8-9de5-a137ad6395cc for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:33:11.144405 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Updating router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 binding host dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:33:11.156042 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'security_group_rule': {'security_group_id': '6de72829-ee9b-4468-8f5f-92fb65675d3b', 'project_id': 'b8df97a650014930beb6e52081be8e90', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:11.168926 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:33:11.172225 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-5ea214b1-6a6b-45b6-8158-26fa4bb70836 None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:33:11.176576 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'status': 'completed', 'code': 200}
May 27 09:33:11.183238 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:security_group_rule and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:33:11.190525 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:33:11.250225 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.292780 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a94cf92f-60af-4a69-b3a5-6e00b5336a11 req-141da441-4d2a-46bb-9d85-037add110e26 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1986003
May 27 09:33:11.341505 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:33:11.429644 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.523933 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d40c9c5-5b19-47a6-92be-8ce6170eb87c req-b4e55749-f5f3-4bb2-a6cf-f06ca6cce15b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:11.527185 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6d40c9c5-5b19-47a6-92be-8ce6170eb87c req-b4e55749-f5f3-4bb2-a6cf-f06ca6cce15b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 1098 time: 0.3295522
May 27 09:33:11.533061 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.676722 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Notify callbacks [] for port, precommit_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.677667 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6c81e8ab-0a53-4020-9be0-7187153d2ae2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Router ad64253e-1ce7-4c03-90db-1073e41e8e5f has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:33:11.690598 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.provisioning_blocks [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Transition to ACTIVE for port object bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 will not be triggered until provisioned by entity L2. {{(pid=91823) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:33:11.703429 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.725936 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-4a4d28f2-b6aa-4415-b952-5c3a27d1f992 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:11.749828 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.758787 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.777021 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c17b8395-2d0a-42aa-a5cf-d94a2ef04ede tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:11.807700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8b6a7987-6f7c-45d6-8b1d-561ff7721534,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:11.813930 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:11.877563 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d40c9c5-5b19-47a6-92be-8ce6170eb87c req-e19e6ff7-3525-41ed-a693-d20254cdb96a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:11.880909 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6d40c9c5-5b19-47a6-92be-8ce6170eb87c req-e19e6ff7-3525-41ed-a693-d20254cdb96a service neutron] 10.222.0.11 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 917 time: 0.3465526
May 27 09:33:11.883038 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-5ea214b1-6a6b-45b6-8158-26fa4bb70836 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecf2fbb0>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': 'bd184371-ce98-4013-aa95-667c89febf8f', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'floating_ip_address': '172.27.1.74', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'port_id': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 483, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'mac_address': 'fa:16:3e:45:6e:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '652a6c44-8948-4153-be12-c818fc126b19', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:32:39Z', 'updated_at': '2021-05-27T09:33:09Z', 'revision_number': 1, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:11.891295 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.891543 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-436dfe80-22c2-4898-bf04-1334b7685e6e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:11.893285 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-33e8f0e6-3584-4c31-9616-d0c26d656675 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.7516186
May 27 09:33:11.896922 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-923bf1df-6ea3-4a8c-baf3-5616bdf6e50e None None] Pushing event updated for resources: {'Port': ['ID=bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62,revision_number=3']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:11.902310 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ea214b1-6a6b-45b6-8158-26fa4bb70836 None None] Checking router: a7747f73-c1a4-4a6c-8c93-cf80d93a5583 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:33:11.906704 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54726) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:11.923698 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ea214b1-6a6b-45b6-8158-26fa4bb70836 None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:33:11.924753 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-5ea214b1-6a6b-45b6-8158-26fa4bb70836 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecf2fbb0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:33:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:11.932430 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'security_group_rule': {'security_group_id': '6de72829-ee9b-4468-8f5f-92fb65675d3b', 'project_id': 'b8df97a650014930beb6e52081be8e90', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:12.138028 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-923bf1df-6ea3-4a8c-baf3-5616bdf6e50e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.412s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:12.206359 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6d40c9c5-5b19-47a6-92be-8ce6170eb87c req-9b55e20f-2ea5-44eb-a93a-a213c4b4726f service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a HTTP/1.1" status: 200  len: 998 time: 0.2916453
May 27 09:33:12.218081 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:33:12.237339 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6c81e8ab-0a53-4020-9be0-7187153d2ae2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:33:12.246109 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6c81e8ab-0a53-4020-9be0-7187153d2ae2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:12.313357 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:security_group_rule and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:33:12.316278 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d626a964-40c9-44b0-83bc-e1299ed43086 None None] Sync routers for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:33:12.330893 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:33:12.347203 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Attempting to bind port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:33:12.347619 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Attempting to bind port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '0830e60f-fb48-48f7-a89b-adcde111560d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6'}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:33:12.347989 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Attempting to bind port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 on network 59236645-74b3-4245-96bc-3faea65c95e6 {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:33:12.353583 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d626a964-40c9-44b0-83bc-e1299ed43086 None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:33:12.354270 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-d626a964-40c9-44b0-83bc-e1299ed43086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed08e280>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:33:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:12.358492 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-5ea214b1-6a6b-45b6-8158-26fa4bb70836 None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:33:12.379422 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:33:12.422688 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-6c81e8ab-0a53-4020-9be0-7187153d2ae2 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "PUT /v2.0/floatingips/6771cfad-a218-4624-a012-a32dc1beb21d HTTP/1.1" status: 200  len: 992 time: 3.0439000
May 27 09:33:12.424040 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d40c9c5-5b19-47a6-92be-8ce6170eb87c req-671f8ee2-c1de-4db0-944f-d9f9eeb6fabb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:12.427346 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'tag': '524ba62d-2814-4825-b3ab-2f96c42b5a0c'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:33:12.440669 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6d40c9c5-5b19-47a6-92be-8ce6170eb87c req-671f8ee2-c1de-4db0-944f-d9f9eeb6fabb service neutron] 10.222.0.11 "GET /v2.0/subnets?id=77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 200  len: 855 time: 0.2238727
May 27 09:33:12.555734 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-d626a964-40c9-44b0-83bc-e1299ed43086 None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:33:12.597283 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:12.682791 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:12.765481 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 33, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:33:12.765857 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Checking segment: {'id': '0830e60f-fb48-48f7-a89b-adcde111560d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91823) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:33:12.766263 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:12.766940 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Bound using segment: {'id': '0830e60f-fb48-48f7-a89b-adcde111560d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6'} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:33:12.767153 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Bound port: bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0830e60f-fb48-48f7-a89b-adcde111560d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 375, 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6'}}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:33:12.767547 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:12.802485 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d40c9c5-5b19-47a6-92be-8ce6170eb87c req-87d22597-ce5a-4ecc-b267-16482df1d791 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:12.804788 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6d40c9c5-5b19-47a6-92be-8ce6170eb87c req-87d22597-ce5a-4ecc-b267-16482df1d791 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=624aa867-a71e-4343-8899-4e49257cd000&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.3536611
May 27 09:33:12.807646 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:12.875218 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:12.903346 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:13.042229 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] For port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91823) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:33:13.046297 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] For port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62,segment=NetworkSegment(0830e60f-fb48-48f7-a89b-adcde111560d),segment_id=0830e60f-fb48-48f7-a89b-adcde111560d)] {{(pid=91823) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:33:13.081416 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-5ea214b1-6a6b-45b6-8158-26fa4bb70836 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecf2fbb0>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': 'bd184371-ce98-4013-aa95-667c89febf8f', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'floating_ip_address': '172.27.1.74', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'port_id': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 483, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'mac_address': 'fa:16:3e:45:6e:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '652a6c44-8948-4153-be12-c818fc126b19', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:32:39Z', 'updated_at': '2021-05-27T09:33:09Z', 'revision_number': 1, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:13.089181 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:13.093498 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ea214b1-6a6b-45b6-8158-26fa4bb70836 None None] The sync data for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi is: [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': 'bd184371-ce98-4013-aa95-667c89febf8f', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'floating_ip_address': '172.27.1.74', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'port_id': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 483, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'mac_address': 'fa:16:3e:45:6e:69', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '652a6c44-8948-4153-be12-c818fc126b19', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:32:39Z', 'updated_at': '2021-05-27T09:33:09Z', 'revision_number': 1, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:33:13.116591 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:13.137698 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4409ac3c-4e85-4111-9c0a-87d31dfb525d req-bb8e4467-ee84-4f28-b13c-b6fef89d972c tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:13.141467 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4409ac3c-4e85-4111-9c0a-87d31dfb525d req-bb8e4467-ee84-4f28-b13c-b6fef89d972c tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 950 time: 0.4103675
May 27 09:33:13.146188 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'tag': '524ba62d-2814-4825-b3ab-2f96c42b5a0c', 'status': 'completed', 'code': 200}
May 27 09:33:13.249143 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-d626a964-40c9-44b0-83bc-e1299ed43086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed08e280>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '6771cfad-a218-4624-a012-a32dc1beb21d', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'floating_ip_address': '172.27.1.212', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'port_id': '524ba62d-2814-4825-b3ab-2f96c42b5a0c', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 495, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'mac_address': 'fa:16:3e:21:83:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:32:41Z', 'updated_at': '2021-05-27T09:33:10Z', 'revision_number': 1, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:13.254214 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Routers {'5b0cc38b-30b3-45d8-9de5-a137ad6395cc'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:33:13.254927 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eedaa4460>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:33:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:13.308717 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f2bccae9-c28c-45dd-8039-8443a9ebc0a7,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:13.316525 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.424s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:13.332729 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d626a964-40c9-44b0-83bc-e1299ed43086 None None] Checking router: ad64253e-1ce7-4c03-90db-1073e41e8e5f for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:33:13.336698 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:13.338077 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 1.4276004
May 27 09:33:13.341390 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54752) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:13.350234 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'security_group_rule': {'security_group_id': '6de72829-ee9b-4468-8f5f-92fb65675d3b', 'project_id': 'b8df97a650014930beb6e52081be8e90', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:13.360531 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d626a964-40c9-44b0-83bc-e1299ed43086 None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:33:13.361213 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-d626a964-40c9-44b0-83bc-e1299ed43086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed08e280>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:33:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:13.365424 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:33:13.375004 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:security_group_rule and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:33:13.384068 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:33:13.388494 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6d40c9c5-5b19-47a6-92be-8ce6170eb87c req-aeeb890f-4aa5-4aa1-8834-0eb9196713b7 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.5743072
May 27 09:33:13.394517 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:33:13.444216 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4409ac3c-4e85-4111-9c0a-87d31dfb525d req-51b47566-1b13-48e2-b834-0fe70a8bf226 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.2878354
May 27 09:33:13.483990 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b8b780-ac1e-454d-aad8-a0c4430cd127 req-a8544a1c-74e4-4561-85d4-5cbc914f85b8 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:13.506153 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-44b8b780-ac1e-454d-aad8-a0c4430cd127 req-a8544a1c-74e4-4561-85d4-5cbc914f85b8 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 945 time: 0.2043376
May 27 09:33:13.506969 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04c005b1-8649-4c40-a632-3244f8f35d14 None None] New status for floating IP bd184371-ce98-4013-aa95-667c89febf8f: ACTIVE {{(pid=91822) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:33:13.542136 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e80e9f64-f02f-44eb-bd8b-5e0d658ff4ad req-f7bcb8d6-8412-43a1-b7c1-76a7de609874 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:13.543745 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e80e9f64-f02f-44eb-bd8b-5e0d658ff4ad req-f7bcb8d6-8412-43a1-b7c1-76a7de609874 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 1099 time: 0.3424499
May 27 09:33:13.633458 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:13.665873 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] Set router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:33:13.729240 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-923bf1df-6ea3-4a8c-baf3-5616bdf6e50e None None] Pushing event updated for resources: {'Port': ['ID=bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62,revision_number=4']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:13.739157 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-6d40c9c5-5b19-47a6-92be-8ce6170eb87c req-bdcb5c94-af56-48eb-91c1-4e533c8221eb service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3419225
May 27 09:33:13.743506 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-923bf1df-6ea3-4a8c-baf3-5616bdf6e50e None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.627s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:13.754473 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:13.760488 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:13.762818 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-861e8cf3-b256-4c75-88d7-e533496327bd tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:13.800296 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=75ebbe42-8127-4d22-8a78-7d5c0fdd8fb3,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:13.809772 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:13.811540 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:13.812911 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.4699297
May 27 09:33:13.815528 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54760) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:13.821741 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'security_group_rule': {'security_group_id': '6de72829-ee9b-4468-8f5f-92fb65675d3b', 'project_id': 'b8df97a650014930beb6e52081be8e90', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:13.830517 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:33:13.834875 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:security_group_rule and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:33:13.838150 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:33:13.846664 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:33:13.867261 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e80e9f64-f02f-44eb-bd8b-5e0d658ff4ad req-1a56eaec-b0b6-4197-99fd-47a24c5e3ac2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:13.868670 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:13.869091 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e80e9f64-f02f-44eb-bd8b-5e0d658ff4ad req-1a56eaec-b0b6-4197-99fd-47a24c5e3ac2 service neutron] 10.222.0.11 "GET /v2.0/networks?id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 200  len: 912 time: 0.3162100
May 27 09:33:13.886539 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-44b8b780-ac1e-454d-aad8-a0c4430cd127 req-43974cc3-145f-4fae-89b1-ef01c9a9e44f tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.3793607
May 27 09:33:13.973705 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:13.980171 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:13.997958 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-d626a964-40c9-44b0-83bc-e1299ed43086 None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:33:14.016703 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0ee81f8b-9381-421f-800c-d0d1a7fbf7db tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:14.038540 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:14.040145 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.2231646
May 27 09:33:14.040841 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5c321fe5-bce8-40f7-a262-2bc5ed55a1a5,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:14.043343 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54766) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:14.045329 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-71fcb1b1-33ff-45a3-9d6d-058887e37a40 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:14.049026 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'security_group_rule': {'security_group_id': '6de72829-ee9b-4468-8f5f-92fb65675d3b', 'project_id': 'b8df97a650014930beb6e52081be8e90', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:14.064526 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:33:14.074220 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:security_group_rule and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:33:14.081576 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:33:14.091311 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:33:14.100322 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e80e9f64-f02f-44eb-bd8b-5e0d658ff4ad req-f69bcfae-e826-4c09-ad9c-987141f5d35d service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=524ba62d-2814-4825-b3ab-2f96c42b5a0c HTTP/1.1" status: 200  len: 1000 time: 0.2091634
May 27 09:33:14.117436 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ca4a608-261f-4bd9-a5ce-9101c775c3d5 req-b6935da2-037a-4454-bd02-b27c55e8d3b1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:14.126087 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9ca4a608-261f-4bd9-a5ce-9101c775c3d5 req-b6935da2-037a-4454-bd02-b27c55e8d3b1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.4964075
May 27 09:33:14.141961 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.securitygroups_db [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Project b8df97a650014930beb6e52081be8e90 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 27 09:33:14.154404 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:14.209350 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e80e9f64-f02f-44eb-bd8b-5e0d658ff4ad req-bf730f14-67c2-4cc4-9ebb-5d9e4a62b62c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:14.211171 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e80e9f64-f02f-44eb-bd8b-5e0d658ff4ad req-bf730f14-67c2-4cc4-9ebb-5d9e4a62b62c service neutron] 10.222.0.11 "GET /v2.0/subnets?id=b2c650ce-3329-4545-aaac-c69109472b2b HTTP/1.1" status: 200  len: 850 time: 0.0819373
May 27 09:33:14.304283 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9ca4a608-261f-4bd9-a5ce-9101c775c3d5 req-3e71c91f-e473-44ad-a57b-ca3c7084d2af tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1771927
May 27 09:33:14.306021 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:14.351430 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:14.369332 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-be1bee34-eafc-4b5f-b4f1-b52c26f18e99 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:14.384196 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e80e9f64-f02f-44eb-bd8b-5e0d658ff4ad req-6dcbd9f7-d364-4193-b444-6758fae85f22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:14.385973 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e80e9f64-f02f-44eb-bd8b-5e0d658ff4ad req-6dcbd9f7-d364-4193-b444-6758fae85f22 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1543727
May 27 09:33:14.388796 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c5dfef83-a95d-4d02-a6e1-b8b3136e8438,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:14.411867 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:14.435355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:14.441952 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-c93fd5ad-2314-4fbe-91ac-7fc58a539b27 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.3983748
May 27 09:33:14.442867 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 54772) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:14.458466 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-cb4892fd-e15f-4e73-b8b9-a015ab045a19 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:14.459562 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-cb4892fd-e15f-4e73-b8b9-a015ab045a19 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Synchronizing usage tracker for tenant:ea51e621877d47f29b60bce5258df734 on resource:port {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:33:14.468000 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'security_group_rule': {'security_group_id': '6de72829-ee9b-4468-8f5f-92fb65675d3b', 'project_id': 'b8df97a650014930beb6e52081be8e90', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:14.485602 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:33:14.496268 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-cb4892fd-e15f-4e73-b8b9-a015ab045a19 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Unset dirty status for tenant:ea51e621877d47f29b60bce5258df734 on resource:port {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:33:14.498170 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-cb4892fd-e15f-4e73-b8b9-a015ab045a19 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.11 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 945 time: 0.1892793
May 27 09:33:14.501935 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:security_group_rule and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:33:14.556050 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:33:14.583412 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:33:14.625881 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.securitygroups_db [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Project b8df97a650014930beb6e52081be8e90 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 27 09:33:14.641894 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:14.643528 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eedaa4460>, [{'id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'name': 'tempest-TestVolumeBootPattern-667651670-router', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159'}], 'enable_snat': True}, 'gw_port_id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:33:01Z', 'updated_at': '2021-05-27T09:33:06Z', 'revision_number': 4, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'gw_port': {'id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:7f:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:33:02Z', 'updated_at': '2021-05-27T09:33:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62', 'name': '', 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'mac_address': 'fa:16:3e:90:71:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': 'e4136c87-14f9-437e-ad77-15645c706d7f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:33:05Z', 'updated_at': '2021-05-27T09:33:13Z', 'revision_number': 4, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'subnets': [{'id': 'e4136c87-14f9-437e-ad77-15645c706d7f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:14.654325 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9eaaf7ae-74cf-4abd-80fe-c2ad51b3f22b None None] The sync data for ids ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'] in dv-cinder-772623-6-iscsi is: [{'id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'name': 'tempest-TestVolumeBootPattern-667651670-router', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159'}], 'enable_snat': True}, 'gw_port_id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:33:01Z', 'updated_at': '2021-05-27T09:33:06Z', 'revision_number': 4, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'gw_port': {'id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:7f:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:33:02Z', 'updated_at': '2021-05-27T09:33:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62', 'name': '', 'network_id': '59236645-74b3-4245-96bc-3faea65c95e6', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'mac_address': 'fa:16:3e:90:71:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'device_owner': 'network:router_interface', 'standard_attr_id': 537, 'fixed_ips': [{'subnet_id': 'e4136c87-14f9-437e-ad77-15645c706d7f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:33:05Z', 'updated_at': '2021-05-27T09:33:13Z', 'revision_number': 4, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'subnets': [{'id': 'e4136c87-14f9-437e-ad77-15645c706d7f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:33:14.712835 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-d626a964-40c9-44b0-83bc-e1299ed43086 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed08e280>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '6771cfad-a218-4624-a012-a32dc1beb21d', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'floating_ip_address': '172.27.1.212', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'port_id': '524ba62d-2814-4825-b3ab-2f96c42b5a0c', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 495, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'mac_address': 'fa:16:3e:21:83:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:32:41Z', 'updated_at': '2021-05-27T09:33:10Z', 'revision_number': 1, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:14.715014 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e80e9f64-f02f-44eb-bd8b-5e0d658ff4ad req-b00b2138-5825-4e76-bb34-a8f618eb3447 service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3219397
May 27 09:33:14.723448 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d626a964-40c9-44b0-83bc-e1299ed43086 None None] The sync data for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi is: [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '6771cfad-a218-4624-a012-a32dc1beb21d', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'floating_ip_address': '172.27.1.212', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'port_id': '524ba62d-2814-4825-b3ab-2f96c42b5a0c', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 495, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'mac_address': 'fa:16:3e:21:83:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:32:41Z', 'updated_at': '2021-05-27T09:33:10Z', 'revision_number': 1, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:33:14.822040 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:14.830430 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:14.844651 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:14.858146 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Deleting port 07dac26a-791f-4736-a4b5-e13624421946 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:33:14.858492 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:14.859098 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a33e601d-8b03-464c-84e4-d775f52d60e1 req-50fdaf8d-a9aa-4ec5-9f04-7a6602bf3fe2 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:14.861815 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a33e601d-8b03-464c-84e4-d775f52d60e1 req-50fdaf8d-a9aa-4ec5-9f04-7a6602bf3fe2 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 950 time: 0.2581487
May 27 09:33:14.910949 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5754236b-8bbf-4dfc-81fa-539e1442340a,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:14.924785 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:14.978962 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:14.986761 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:14.986970 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a33e601d-8b03-464c-84e4-d775f52d60e1 req-587b3fbe-2352-4dba-922d-ae539330f534 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1114504
May 27 09:33:14.990937 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-62743799-01a8-45b7-8f74-3594caa59dbb tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.5439296
May 27 09:33:15.022781 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e80e9f64-f02f-44eb-bd8b-5e0d658ff4ad req-ad0a2255-369d-4e5a-a0f4-3240e8552048 service neutron] 10.222.0.11 "GET /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2997591
May 27 09:33:15.090456 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] For port 07dac26a-791f-4736-a4b5-e13624421946, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=07dac26a-791f-4736-a4b5-e13624421946,segment=NetworkSegment(111bd85e-76cc-4ba7-8f48-b8ddd0684287),segment_id=111bd85e-76cc-4ba7-8f48-b8ddd0684287)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:15.090825 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:15.201460 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d8fc36-141e-42cc-9911-8ad88a4ffc4c req-60a2f8df-9f6f-4aaf-8b47-108a857ad63f tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:15.204632 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f6d8fc36-141e-42cc-9911-8ad88a4ffc4c req-60a2f8df-9f6f-4aaf-8b47-108a857ad63f tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 945 time: 0.1380379
May 27 09:33:15.244371 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65e8fc5d-7543-4bf9-8bec-163349af6e14 None None] New status for floating IP 6771cfad-a218-4624-a012-a32dc1beb21d: ACTIVE {{(pid=91823) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:33:15.303407 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f6d8fc36-141e-42cc-9911-8ad88a4ffc4c req-55cedfe1-02b5-4a92-b7bb-49152efa464c tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/security-groups?id=153060e3-7aa0-458d-9022-cda03d192fae&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0782979
May 27 09:33:15.316649 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Calling delete_port for 07dac26a-791f-4736-a4b5-e13624421946 owned by compute:nova {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:33:15.500863 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:15.510392 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:15.521322 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['07dac26a-791f-4736-a4b5-e13624421946'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:33:15.604515 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9abbf60-ed9c-4bb1-93c5-2dd3ebcf9bce req-79ab4c0b-2325-49b4-9893-88154a835858 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:15.617051 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c9abbf60-ed9c-4bb1-93c5-2dd3ebcf9bce req-79ab4c0b-2325-49b4-9893-88154a835858 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.1666515
May 27 09:33:15.688252 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Pushing event deleted for resources: {'Port': ['ID=07dac26a-791f-4736-a4b5-e13624421946,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:15.693899 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:15.729066 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c9abbf60-ed9c-4bb1-93c5-2dd3ebcf9bce req-19bd27b6-6d72-4c39-8899-f0278e6576d0 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1101820
May 27 09:33:15.815781 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] No DVR routers for this DVR port 07dac26a-791f-4736-a4b5-e13624421946 on host hv-cinder-77262 {{(pid=91820) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:33:15.818355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:15.821218 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da', 'name': 'network-vif-deleted', 'tag': '07dac26a-791f-4736-a4b5-e13624421946'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:33:15.839693 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-a73acaf3-0719-4a07-8961-397126cc54f6 req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.11 "DELETE /v2.0/ports/07dac26a-791f-4736-a4b5-e13624421946 HTTP/1.1" status: 204  len: 173 time: 1.3318341
May 27 09:33:15.884925 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da', 'name': 'network-vif-deleted', 'tag': '07dac26a-791f-4736-a4b5-e13624421946', 'status': 'completed', 'code': 200}
May 27 09:33:16.018585 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a8801f2-c79a-4c9f-aaf6-d3cec7f6d1f7 req-49cd2efa-8b53-4b7b-b5f7-56e0b843ce2c tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:16.024518 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8a8801f2-c79a-4c9f-aaf6-d3cec7f6d1f7 req-49cd2efa-8b53-4b7b-b5f7-56e0b843ce2c tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.11 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 950 time: 0.1958675
May 27 09:33:16.305846 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-8a8801f2-c79a-4c9f-aaf6-d3cec7f6d1f7 req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Deleting port aa098b16-c767-480e-b777-c4ba67a185a4 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:33:16.305846 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-8a8801f2-c79a-4c9f-aaf6-d3cec7f6d1f7 req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:16.368906 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c00b4da-0eb1-44a3-84ec-e63a900b49e2 req-a380d26d-d9d8-4348-80c2-420aef2d5821 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:16.371636 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4c00b4da-0eb1-44a3-84ec-e63a900b49e2 req-a380d26d-d9d8-4348-80c2-420aef2d5821 tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 950 time: 0.1945090
May 27 09:33:16.430132 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:16.555271 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:33:16.573717 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:16.574755 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:16.705410 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4c00b4da-0eb1-44a3-84ec-e63a900b49e2 req-a89a171c-f116-4a13-a773-60c782f0ccdc tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/security-groups?id=54cad300-eedf-4e53-bf20-56c36236c185&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0723033
May 27 09:33:16.767812 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:16.789125 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-8a8801f2-c79a-4c9f-aaf6-d3cec7f6d1f7 req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] For port aa098b16-c767-480e-b777-c4ba67a185a4, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=aa098b16-c767-480e-b777-c4ba67a185a4,segment=NetworkSegment(ff06cfec-4c84-4b3f-8844-ab24b7be9cca),segment_id=ff06cfec-4c84-4b3f-8844-ab24b7be9cca)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:16.789728 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-8a8801f2-c79a-4c9f-aaf6-d3cec7f6d1f7 req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:16.804928 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62,segment=NetworkSegment(0830e60f-fb48-48f7-a89b-adcde111560d),segment_id=0830e60f-fb48-48f7-a89b-adcde111560d)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:16.805848 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-09c45e62-0c6f-4040-8f6c-50c18ceafb2d req-a01fd9f2-ef3e-4e54-a73b-d025a75eaad7 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] 10.222.0.30 "GET /v2.0/ports?device_id=7bc1a274-e4a0-4c75-b3d6-a03a32b6a0da HTTP/1.1" status: 200  len: 210 time: 0.0631599
May 27 09:33:16.811758 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:16.820195 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-c30aa56e-48df-4910-a11f-b45f4a030c23 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:16.943528 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:16.946599 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.127s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:16.960686 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-8a8801f2-c79a-4c9f-aaf6-d3cec7f6d1f7 req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Calling delete_port for aa098b16-c767-480e-b777-c4ba67a185a4 owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:33:17.051050 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f713ce0-b791-4b1c-8033-e86f191355bf req-a5b8f0c8-b6b2-42d7-9704-51efdd870d29 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:17.052581 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2f713ce0-b791-4b1c-8033-e86f191355bf req-a5b8f0c8-b6b2-42d7-9704-51efdd870d29 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.1302648
May 27 09:33:17.160022 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2f713ce0-b791-4b1c-8033-e86f191355bf req-713f2afe-adaa-43fe-a113-1fd616548b6f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1010866
May 27 09:33:17.167843 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-8a8801f2-c79a-4c9f-aaf6-d3cec7f6d1f7 req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:17.174280 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:17.179742 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['aa098b16-c767-480e-b777-c4ba67a185a4'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:33:17.227901 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Pushing event deleted for resources: {'Port': ['ID=aa098b16-c767-480e-b777-c4ba67a185a4,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:17.267969 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.268345 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.268720 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.269079 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.269439 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.269791 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.270142 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.270492 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.270845 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.271193 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.271570 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.271918 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:17.279540 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:17.319715 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-8a8801f2-c79a-4c9f-aaf6-d3cec7f6d1f7 req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] No DVR routers for this DVR port aa098b16-c767-480e-b777-c4ba67a185a4 on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:33:17.322105 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-8a8801f2-c79a-4c9f-aaf6-d3cec7f6d1f7 req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:17.326316 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6757e96f-c173-47bc-ba37-1fc4e9b0347d', 'name': 'network-vif-deleted', 'tag': 'aa098b16-c767-480e-b777-c4ba67a185a4'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:33:17.333765 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8a8801f2-c79a-4c9f-aaf6-d3cec7f6d1f7 req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.11 "DELETE /v2.0/ports/aa098b16-c767-480e-b777-c4ba67a185a4 HTTP/1.1" status: 204  len: 173 time: 1.3030839
May 27 09:33:17.391733 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6757e96f-c173-47bc-ba37-1fc4e9b0347d', 'name': 'network-vif-deleted', 'tag': 'aa098b16-c767-480e-b777-c4ba67a185a4', 'status': 'completed', 'code': 200}
May 27 09:33:17.594822 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 07dac26a-791f-4736-a4b5-e13624421946 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:33:17.634145 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 07dac26a-791f-4736-a4b5-e13624421946 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:33:17.634497 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 07dac26a-791f-4736-a4b5-e13624421946 not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:33:17.634968 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device aa098b16-c767-480e-b777-c4ba67a185a4 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:33:17.674665 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: aa098b16-c767-480e-b777-c4ba67a185a4 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:33:17.675182 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device aa098b16-c767-480e-b777-c4ba67a185a4 not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:33:17.910381 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-d8f67357-2d03-4ec7-95c6-36092ad8e300 req-e008928f-5ac3-4d9b-b2b1-0b5d29b4f04a tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Synchronizing usage tracker for tenant:46febd5e53624a3cb1c861af3e9c8d61 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:33:17.929671 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-d8f67357-2d03-4ec7-95c6-36092ad8e300 req-e008928f-5ac3-4d9b-b2b1-0b5d29b4f04a tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Unset dirty status for tenant:46febd5e53624a3cb1c861af3e9c8d61 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:33:17.931087 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d8f67357-2d03-4ec7-95c6-36092ad8e300 req-e008928f-5ac3-4d9b-b2b1-0b5d29b4f04a tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] 10.222.0.30 "GET /v2.0/ports?device_id=6757e96f-c173-47bc-ba37-1fc4e9b0347d HTTP/1.1" status: 200  len: 210 time: 0.0845339
May 27 09:33:18.359102 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:18.432814 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa03cb5f-a7c1-4c7d-9e7a-89310b79b6c2 req-3cc4c839-89d6-4c45-9cc2-5cb54283242a tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:18.442101 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fa03cb5f-a7c1-4c7d-9e7a-89310b79b6c2 req-3cc4c839-89d6-4c45-9cc2-5cb54283242a tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.1512287
May 27 09:33:18.455828 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:18.455828 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:18.509153 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fa03cb5f-a7c1-4c7d-9e7a-89310b79b6c2 req-6c70d356-e6d1-4378-83c6-f98992e01a88 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0657845
May 27 09:33:19.965554 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e93273-23af-4ea9-b46c-084290d0c923 req-2a39dd4b-cdf3-4305-ad6a-f0499cedb69a tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:19.967839 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-76e93273-23af-4ea9-b46c-084290d0c923 req-2a39dd4b-cdf3-4305-ad6a-f0499cedb69a tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.1083682
May 27 09:33:20.036873 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-76e93273-23af-4ea9-b46c-084290d0c923 req-a4ebf337-6235-402e-8efb-48b2b6bd117c tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0626025
May 27 09:33:23.547195 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7295860e-de25-41de-8384-3e425eb779c1 req-ce67b07c-efc5-48bc-9cd6-27c879044a22 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:23.548736 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7295860e-de25-41de-8384-3e425eb779c1 req-ce67b07c-efc5-48bc-9cd6-27c879044a22 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.0939109
May 27 09:33:23.602423 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7295860e-de25-41de-8384-3e425eb779c1 req-0f7a329b-9d22-4a45-b042-5b7852ac8cfc tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0479841
May 27 09:33:24.617294 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55150) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:24.872144 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-925be4ff-703c-4c94-95c9-446a97588d69 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=46febd5e53624a3cb1c861af3e9c8d61&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2524540
May 27 09:33:24.876882 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 55158) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:24.972070 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c83db557-e300-4ef0-acb7-32535355548b req-ad028885-39c2-4a44-b2eb-a2a079d7592b tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:24.974445 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c83db557-e300-4ef0-acb7-32535355548b req-ad028885-39c2-4a44-b2eb-a2a079d7592b tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.1809177
May 27 09:33:25.007006 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-888ec07c-270f-400c-a328-55858456d859 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:25.065775 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-888ec07c-270f-400c-a328-55858456d859 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:25.080069 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c83db557-e300-4ef0-acb7-32535355548b req-1ec0ad62-c0ef-4023-8537-652793fa9272 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0902429
May 27 09:33:25.147852 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-888ec07c-270f-400c-a328-55858456d859 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:25.153843 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-55d46913-abd7-4c33-9d85-68fa18a10aad admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:25.167940 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-888ec07c-270f-400c-a328-55858456d859 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54cad300-eedf-4e53-bf20-56c36236c185,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:25.171456 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-888ec07c-270f-400c-a328-55858456d859 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:25.179419 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-888ec07c-270f-400c-a328-55858456d859 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:25.180567 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-888ec07c-270f-400c-a328-55858456d859 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/54cad300-eedf-4e53-bf20-56c36236c185 HTTP/1.1" status: 204  len: 168 time: 0.3020830
May 27 09:33:26.364924 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07eb4793-7160-46ed-ac6c-e19e569615ed req-ccf2b21c-d474-48d6-a8c4-d00a72162666 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:26.367967 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-07eb4793-7160-46ed-ac6c-e19e569615ed req-ccf2b21c-d474-48d6-a8c4-d00a72162666 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.1166828
May 27 09:33:26.407766 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:26.441400 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-07eb4793-7160-46ed-ac6c-e19e569615ed req-8b6c48b0-e11d-451d-a3c7-3fa7a64b1a58 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0670013
May 27 09:33:27.667221 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-346aee43-7d5e-4441-b139-879b16ff51e5 req-7413b314-fb9c-4dd9-a994-75cb7dc0a373 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:27.669520 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-346aee43-7d5e-4441-b139-879b16ff51e5 req-7413b314-fb9c-4dd9-a994-75cb7dc0a373 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.1053407
May 27 09:33:27.726210 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-346aee43-7d5e-4441-b139-879b16ff51e5 req-42aed0a7-6b2c-4771-8663-f7769ba874e5 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0475125
May 27 09:33:27.943941 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d782ea0-4048-4896-9026-cda7a460d3b3 req-f6de1722-1230-4a72-9a37-f543a92fd899 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:27.945456 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9d782ea0-4048-4896-9026-cda7a460d3b3 req-f6de1722-1230-4a72-9a37-f543a92fd899 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a31154df1ce4420f9bdf53b8b3b3649e&device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 1098 time: 0.0942967
May 27 09:33:28.133577 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d782ea0-4048-4896-9026-cda7a460d3b3 req-cf270121-ec5c-45ca-8710-df476d836207 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:28.135147 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9d782ea0-4048-4896-9026-cda7a460d3b3 req-cf270121-ec5c-45ca-8710-df476d836207 service neutron] 10.222.0.11 "GET /v2.0/networks?id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba HTTP/1.1" status: 200  len: 909 time: 0.1612763
May 27 09:33:28.414050 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9d782ea0-4048-4896-9026-cda7a460d3b3 req-bde31db2-905a-4b7c-b847-70b6347ecf85 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d HTTP/1.1" status: 200  len: 1000 time: 0.2708585
May 27 09:33:28.490849 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d782ea0-4048-4896-9026-cda7a460d3b3 req-a46f931d-7433-40ac-9a03-6845e915c1a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:28.492642 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9d782ea0-4048-4896-9026-cda7a460d3b3 req-a46f931d-7433-40ac-9a03-6845e915c1a3 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6659533b-b3b0-4d3c-8bf0-709a19b7728d HTTP/1.1" status: 200  len: 847 time: 0.0710089
May 27 09:33:28.594023 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d782ea0-4048-4896-9026-cda7a460d3b3 req-163bfa58-0285-4d45-9375-571dd6e75be5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:28.595803 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9d782ea0-4048-4896-9026-cda7a460d3b3 req-163bfa58-0285-4d45-9375-571dd6e75be5 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0944619
May 27 09:33:28.765661 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9d782ea0-4048-4896-9026-cda7a460d3b3 req-c8416de7-4185-465b-b53d-eb10be912155 service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1602454
May 27 09:33:28.978995 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9d782ea0-4048-4896-9026-cda7a460d3b3 req-17cc0796-54a9-428f-9e30-d38460fe51cb service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2041302
May 27 09:33:29.022075 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59bcde83-eb91-41af-8aa3-d9403574f8d7 req-72877bc2-7d3d-4eb0-90df-f30c6e3b131b tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:29.023898 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-59bcde83-eb91-41af-8aa3-d9403574f8d7 req-72877bc2-7d3d-4eb0-90df-f30c6e3b131b tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.1315053
May 27 09:33:29.149370 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-59bcde83-eb91-41af-8aa3-d9403574f8d7 req-f143c78e-2c20-45f6-bd6a-17e681eaf580 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1127622
May 27 09:33:29.184493 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b423bed-7379-4302-aea0-4cc670763c73 req-da81a6d1-c9b1-4c32-af40-7edbe2bb0c60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:29.186820 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b423bed-7379-4302-aea0-4cc670763c73 req-da81a6d1-c9b1-4c32-af40-7edbe2bb0c60 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a31154df1ce4420f9bdf53b8b3b3649e&device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 1098 time: 0.1339481
May 27 09:33:29.356682 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b423bed-7379-4302-aea0-4cc670763c73 req-6888c99d-5bd1-4706-87cf-d7d5cd216c1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:29.358932 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b423bed-7379-4302-aea0-4cc670763c73 req-6888c99d-5bd1-4706-87cf-d7d5cd216c1d service neutron] 10.222.0.11 "GET /v2.0/networks?id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba HTTP/1.1" status: 200  len: 909 time: 0.1646402
May 27 09:33:29.487727 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b423bed-7379-4302-aea0-4cc670763c73 req-1381c894-8242-4f28-b2cb-b516f3e61820 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d HTTP/1.1" status: 200  len: 1000 time: 0.1215446
May 27 09:33:29.571857 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b423bed-7379-4302-aea0-4cc670763c73 req-b6375c7b-3b8f-467f-89b3-c037e5dcde41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:29.579521 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b423bed-7379-4302-aea0-4cc670763c73 req-b6375c7b-3b8f-467f-89b3-c037e5dcde41 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6659533b-b3b0-4d3c-8bf0-709a19b7728d HTTP/1.1" status: 200  len: 847 time: 0.0803471
May 27 09:33:29.676942 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b423bed-7379-4302-aea0-4cc670763c73 req-7e5c4342-342a-4af8-aa8d-cb323bda160a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:29.678460 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b423bed-7379-4302-aea0-4cc670763c73 req-7e5c4342-342a-4af8-aa8d-cb323bda160a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0933595
May 27 09:33:29.838139 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b423bed-7379-4302-aea0-4cc670763c73 req-d322ed6d-f039-4dc5-aa92-d0a992fae093 service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1504040
May 27 09:33:29.988726 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8b423bed-7379-4302-aea0-4cc670763c73 req-e8603a37-b542-4f55-aa96-2a99c7822fde service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1415544
May 27 09:33:30.370604 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a9eda5-001e-4ba2-8abc-11fca3e199fd req-4bdfe993-a9b4-4e6e-a55d-7b0ca0ebb441 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:30.372200 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10a9eda5-001e-4ba2-8abc-11fca3e199fd req-4bdfe993-a9b4-4e6e-a55d-7b0ca0ebb441 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.0824878
May 27 09:33:30.419497 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10a9eda5-001e-4ba2-8abc-11fca3e199fd req-c9d78f5a-bb5b-4d29-b7b8-267b8e6a6557 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0410693
May 27 09:33:33.356264 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b63c4f-d6ee-49ee-8e50-a44043b5aace req-820224c2-4888-42e3-b02f-eb563c75be5c tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:33.364260 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-35b63c4f-d6ee-49ee-8e50-a44043b5aace req-820224c2-4888-42e3-b02f-eb563c75be5c tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.0986111
May 27 09:33:33.408255 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-35b63c4f-d6ee-49ee-8e50-a44043b5aace req-1ed9577d-4967-4a5b-9182-391c73d50f6f tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430491
May 27 09:33:34.636548 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62a3e92e-664f-4682-ad39-c363dab57494 req-5272ed53-affe-42e0-aa04-ee958de8860c tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:34.638212 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-62a3e92e-664f-4682-ad39-c363dab57494 req-5272ed53-affe-42e0-aa04-ee958de8860c tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.0891569
May 27 09:33:34.773899 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-62a3e92e-664f-4682-ad39-c363dab57494 req-fad479af-4128-41f5-bb65-5f6395fc9d11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1291759
May 27 09:33:35.974981 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9d45e0-b134-4959-9eff-b1163085b98a req-be21c61a-59bf-4a36-ba85-6babbdf31c28 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:35.976531 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6c9d45e0-b134-4959-9eff-b1163085b98a req-be21c61a-59bf-4a36-ba85-6babbdf31c28 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.0837119
May 27 09:33:36.026115 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6c9d45e0-b134-4959-9eff-b1163085b98a req-fac88505-3329-47bf-b33b-12063ab73b40 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418844
May 27 09:33:36.340588 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-fab1e445-0dda-4e57-ac11-fffbad85af03 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.0825813
May 27 09:33:36.412887 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18b317a5-8adb-42e9-a614-cf47f6848d72 req-79caaa5a-0157-4176-9850-6b366046c1d5 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:36.414457 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-18b317a5-8adb-42e9-a614-cf47f6848d72 req-79caaa5a-0157-4176-9850-6b366046c1d5 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.0925004
May 27 09:33:36.468389 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-18b317a5-8adb-42e9-a614-cf47f6848d72 req-ce8ad404-cbef-4a7c-80c4-916d184338b1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0463114
May 27 09:33:37.675069 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15dcd91d-5dfa-443b-92da-7a3b6e367ec2 req-710157a4-943f-47e5-b92a-38b058efadcc tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:37.675732 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-15dcd91d-5dfa-443b-92da-7a3b6e367ec2 req-710157a4-943f-47e5-b92a-38b058efadcc tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.0843351
May 27 09:33:37.688559 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:33:37.734042 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-15dcd91d-5dfa-443b-92da-7a3b6e367ec2 req-ebd40bcc-c1ba-4d09-989c-ffc7a41dea61 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0516467
May 27 09:33:37.823407 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:37.858962 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:33:37.869345 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:37.875837 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:37.878597 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:37.934270 dv-cinder-772623-6-iscsi neutron-server[91822]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'code': 422} returned with failed status
May 27 09:33:37.985630 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,revision_number=6']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:37.988986 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:38.465421 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-98af756d-42ec-4427-ac70-6b5330cd0567 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:38.467173 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-98af756d-42ec-4427-ac70-6b5330cd0567 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63&tenant_id=a31154df1ce4420f9bdf53b8b3b3649e HTTP/1.1" status: 200  len: 1096 time: 0.0855651
May 27 09:33:38.499549 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ab616967-e01f-4e11-8dc6-89e263419fbc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:38.622620 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-76eb6fd7-c848-4a71-bc35-1f1f9999937d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:38.625328 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-76eb6fd7-c848-4a71-bc35-1f1f9999937d service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a31154df1ce4420f9bdf53b8b3b3649e&device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 1096 time: 0.1343906
May 27 09:33:38.776426 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-68413cdd-7fb8-44b2-9788-62d1783cf4e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:38.777935 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-68413cdd-7fb8-44b2-9788-62d1783cf4e2 service neutron] 10.222.0.11 "GET /v2.0/networks?id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba HTTP/1.1" status: 200  len: 909 time: 0.1457350
May 27 09:33:38.979616 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-df67e7c1-05f5-4cdf-b06c-b4dd9722b4a9 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d HTTP/1.1" status: 200  len: 998 time: 0.1940186
May 27 09:33:38.984075 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-42902a96-5507-4a7a-a950-79e8f82c1c9d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1951300864&fields=id&tenant_id=b8df97a650014930beb6e52081be8e90 HTTP/1.1" status: 200  len: 267 time: 0.1405778
May 27 09:33:39.148945 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-265bd095-04bd-4b25-b19d-0eb9640e5ab3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:39.150455 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-265bd095-04bd-4b25-b19d-0eb9640e5ab3 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6659533b-b3b0-4d3c-8bf0-709a19b7728d HTTP/1.1" status: 200  len: 847 time: 0.1622651
May 27 09:33:39.223933 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a78750ac-ac88-4c31-bfd9-927255ca0f8e req-4308e53f-f23a-4cb4-a65f-7c0e9ac90909 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:39.225429 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a78750ac-ac88-4c31-bfd9-927255ca0f8e req-4308e53f-f23a-4cb4-a65f-7c0e9ac90909 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.3617835
May 27 09:33:39.280849 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-44f6849e-2923-4f9a-ace8-f8ae47eba4bc tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:39.282298 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-44f6849e-2923-4f9a-ace8-f8ae47eba4bc tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 811 time: 0.2626457
May 27 09:33:39.314849 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-59fcb1a7-78eb-4c9b-a023-7430406d16e9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/quotas/b8df97a650014930beb6e52081be8e90 HTTP/1.1" status: 200  len: 375 time: 0.0213175
May 27 09:33:39.320265 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a78750ac-ac88-4c31-bfd9-927255ca0f8e req-7e4f80ea-939e-4f99-a79c-4ec8e5828806 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0802910
May 27 09:33:39.389609 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-acfcdb59-3594-4c42-a1fc-cf5f427f4dba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:39.391090 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-acfcdb59-3594-4c42-a1fc-cf5f427f4dba service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2189159
May 27 09:33:39.524593 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-ea003d1f-16fa-4a52-b8a7-9131efc807fa tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&fields=id HTTP/1.1" status: 200  len: 302 time: 0.2023654
May 27 09:33:39.557603 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-eeea90a1-06bd-40eb-8e83-ff3690b5e1de service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1588871
May 27 09:33:39.789650 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-616e43f6-c4ac-4fc9-9a64-17186d02bad4 req-9932c50d-083c-4e6f-819b-75b883b12b47 service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2227368
May 27 09:33:39.940123 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-18714f7b-f0b5-4a1a-af59-e44bc46a3d92 service neutron] 10.222.0.30 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.3960800
May 27 09:33:40.118723 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-c36abeea-6289-4d11-83cd-df246a796500 service neutron] 10.222.0.30 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1723719
May 27 09:33:40.548101 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5536ef2b-4489-4d84-a063-3cb2f59e1f2b req-dfb174bb-7475-4ad9-9925-b033f8426b55 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:40.549643 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5536ef2b-4489-4d84-a063-3cb2f59e1f2b req-dfb174bb-7475-4ad9-9925-b033f8426b55 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.1011710
May 27 09:33:40.597571 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5536ef2b-4489-4d84-a063-3cb2f59e1f2b req-6313b316-1951-4eda-8a7c-7aad804fb027 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415857
May 27 09:33:41.450534 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:41.658269 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-77e8633d-5ace-4b6e-bb55-3b85c2d0dba2 req-89448e18-6f9e-4057-bd79-9446726d9677 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 210 time: 0.0614364
May 27 09:33:41.834023 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-cf8d4ccd-e591-428a-8df8-1a4962598422 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:41.907261 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c19270-2e80-4fe9-b417-8f7dcba8af4f req-ca0e02ca-4f3f-4cee-8424-1316d0453d9a tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:41.909228 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-79c19270-2e80-4fe9-b417-8f7dcba8af4f req-ca0e02ca-4f3f-4cee-8424-1316d0453d9a tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.1491261
May 27 09:33:41.969728 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-79c19270-2e80-4fe9-b417-8f7dcba8af4f req-9dc6772e-f60c-48de-97d2-9b2f1d8bd3b1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0542598
May 27 09:33:42.369706 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:42.850666 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-39f971fa-8ae8-4058-a765-971e5cebe618 req-d93c9de1-c1ad-4903-9c20-f886b41c6bbd tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 210 time: 0.0632391
May 27 09:33:43.120278 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:33:43.190406 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-6b854a2e-c56e-47e5-8953-855215ac80a9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:43.192032 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-6b854a2e-c56e-47e5-8953-855215ac80a9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 811 time: 0.2491298
May 27 09:33:43.261295 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-a40a3dc1-3dfa-4ad4-bc6b-a6ae90a3c394 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b8df97a650014930beb6e52081be8e90 HTTP/1.1" status: 200  len: 380 time: 0.0579586
May 27 09:33:43.281503 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-311abe91-1a89-4ebf-ad7f-33988ff955bc req-bdf5f304-ff81-4653-9332-6a7ff5d26449 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:43.283062 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-311abe91-1a89-4ebf-ad7f-33988ff955bc req-bdf5f304-ff81-4653-9332-6a7ff5d26449 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.1421933
May 27 09:33:43.288041 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'port': {'device_id': '833aa915-b338-444b-b501-e9dac73b7858', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'admin_state_up': True, 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'security_groups': ['6de72829-ee9b-4468-8f5f-92fb65675d3b']}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:43.433100 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-311abe91-1a89-4ebf-ad7f-33988ff955bc req-69c9a13c-b37a-4084-929e-cdf2b2d21f37 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1304269
May 27 09:33:43.490633 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:33:43.495501 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:port and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:33:43.499595 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for port was recalculated. Used quota:2. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:33:43.505770 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:33:43.526818 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Made reservation on behalf of b8df97a650014930beb6e52081be8e90 for: {'port': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:33:43.531837 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:43.737736 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Allocated IP 172.20.0.13 (d58a455f-cc80-4aa7-a530-ce993d4da5e4/3187e919-f2c3-422d-8e9c-3d158ef72b40/9734bd01-bec4-4629-a99e-36b3d4950146) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:33:44.069326 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-eaf98d9a-f616-44ca-9a1d-cacb010dcf5b req-b63e3b52-b39b-46ac-9133-4ace4dc2dd9d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 210 time: 0.0918174
May 27 09:33:44.137812 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:44.159294 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Transition to ACTIVE for port object 9734bd01-bec4-4629-a99e-36b3d4950146 will not be triggered until provisioned by entity DHCP. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:33:44.193698 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:44.201737 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:44.293925 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Network d58a455f-cc80-4aa7-a530-ce993d4da5e4 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:33:44.299876 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:33:44.307927 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:33:44.388362 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'Port': ['ID=9734bd01-bec4-4629-a99e-36b3d4950146,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:44.397743 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:44.429182 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:44.430028 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:44.472072 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-2003ec32-2425-4b5f-be64-c991ce245b43 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.1876261
May 27 09:33:44.489339 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Request body: {'port': {'device_id': '833aa915-b338-444b-b501-e9dac73b7858', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:33:44.578037 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-e50b42ed-3629-4cfd-bbc1-09c0cfe929ad None None] Provisioning for port 9734bd01-bec4-4629-a99e-36b3d4950146 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:33:44.584824 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-e50b42ed-3629-4cfd-bbc1-09c0cfe929ad None None] Provisioning complete for port 9734bd01-bec4-4629-a99e-36b3d4950146 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:44.585293 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e50b42ed-3629-4cfd-bbc1-09c0cfe929ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:44.676163 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-e50b42ed-3629-4cfd-bbc1-09c0cfe929ad None None] Port 9734bd01-bec4-4629-a99e-36b3d4950146 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:33:44.678686 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:44.877459 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db4eda34-e0fe-429b-a92a-753f518d8f8b req-e498f6fe-3ce5-48e0-a47b-c63d78303fc9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:44.879091 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-db4eda34-e0fe-429b-a92a-753f518d8f8b req-e498f6fe-3ce5-48e0-a47b-c63d78303fc9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2877676
May 27 09:33:44.935675 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:44.998382 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55434) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:45.018526 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-db4eda34-e0fe-429b-a92a-753f518d8f8b req-21b2e9dc-83ee-4d84-8138-908fc8f9e256 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0948694
May 27 09:33:45.100585 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_v2 [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Deleting subnet b5e42a76-0f30-4445-a1f6-5d4cc78bf42c {{(pid=91820) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:33:45.105879 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:45.169164 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3483778'] for subnet, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:45.241703 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:45.313654 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9734bd01-bec4-4629-a99e-36b3d4950146 {{(pid=91821) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:33:45.333738 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:45.366739 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Transition to ACTIVE for port object 9734bd01-bec4-4629-a99e-36b3d4950146 will not be triggered until provisioned by entity L2. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:33:45.372277 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:45.378204 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-beebba08-8585-489a-813a-b8ac0efd921e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:45.505433 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c24852ad-f6a8-46e6-ba5a-6e8dc27d0d98 req-7304329d-564b-4c1a-8ed2-c968fa6b5323 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:45.506209 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-c24852ad-f6a8-46e6-ba5a-6e8dc27d0d98 req-7304329d-564b-4c1a-8ed2-c968fa6b5323 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Synchronizing usage tracker for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:33:45.596439 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Pushing event updated for resources: {'Port': ['ID=9734bd01-bec4-4629-a99e-36b3d4950146,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:45.599778 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:45.668590 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-c24852ad-f6a8-46e6-ba5a-6e8dc27d0d98 req-7304329d-564b-4c1a-8ed2-c968fa6b5323 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Unset dirty status for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:33:45.678305 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c24852ad-f6a8-46e6-ba5a-6e8dc27d0d98 req-7304329d-564b-4c1a-8ed2-c968fa6b5323 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 932 time: 0.4488513
May 27 09:33:45.770438 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Attempting to bind port 9734bd01-bec4-4629-a99e-36b3d4950146 on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:33:45.770857 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Attempting to bind port 9734bd01-bec4-4629-a99e-36b3d4950146 by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:33:45.771380 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Attempting to bind port 9734bd01-bec4-4629-a99e-36b3d4950146 on network d58a455f-cc80-4aa7-a530-ce993d4da5e4 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:33:45.777711 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2421409', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2490042'] for subnet, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:45.787102 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c24852ad-f6a8-46e6-ba5a-6e8dc27d0d98 req-2960fa24-b153-4e90-b9b1-ceeb3485876a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1076760
May 27 09:33:45.788200 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Port 9734bd01-bec4-4629-a99e-36b3d4950146 on network d58a455f-cc80-4aa7-a530-ce993d4da5e4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:33:45.788671 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Attempting to bind port 9734bd01-bec4-4629-a99e-36b3d4950146 on network d58a455f-cc80-4aa7-a530-ce993d4da5e4 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:33:45.789226 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7a3e7e88-7ea9-418d-88be-1a0fe3b0ea9c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:45.800311 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 33, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:33:45.800808 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Checking segment: {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:33:45.801370 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Bound using segment: {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:33:45.802254 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Bound port: 9734bd01-bec4-4629-a99e-36b3d4950146, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'}}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:33:45.802779 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:45.848347 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b5e42a76-0f30-4445-a1f6-5d4cc78bf42c,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:45.851279 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:45.862204 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.862587 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.862968 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.863336 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.863845 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.864109 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.864487 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.864846 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.865209 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.865567 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.865936 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.866281 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:45.870332 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:45.874948 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/b5e42a76-0f30-4445-a1f6-5d4cc78bf42c HTTP/1.1" status: 204  len: 168 time: 0.8727479
May 27 09:33:45.875309 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55444) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:45.922384 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] For port 9734bd01-bec4-4629-a99e-36b3d4950146, host hv-cinder-77262, cleared binding levels {{(pid=91821) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:33:45.926075 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] For port 9734bd01-bec4-4629-a99e-36b3d4950146, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9734bd01-bec4-4629-a99e-36b3d4950146,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91821) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:33:45.932907 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:45.938808 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-2db85f5b-f866-490f-90df-b41383967c4a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:46.006163 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:46.006795 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:46.006968 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:46.008524 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] 10.222.0.11 "PUT /v2.0/ports/9734bd01-bec4-4629-a99e-36b3d4950146 HTTP/1.1" status: 200  len: 1094 time: 1.5272717
May 27 09:33:46.008869 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '833aa915-b338-444b-b501-e9dac73b7858', 'tag': '9734bd01-bec4-4629-a99e-36b3d4950146'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:33:46.038976 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Pushing event updated for resources: {'Port': ['ID=9734bd01-bec4-4629-a99e-36b3d4950146,revision_number=3']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:46.043784 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:46.125015 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '833aa915-b338-444b-b501-e9dac73b7858', 'tag': '9734bd01-bec4-4629-a99e-36b3d4950146', 'status': 'completed', 'code': 200}
May 27 09:33:46.173767 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:46.193353 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-04e6819c-6a1d-4a88-9fde-21127206c5c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:46.195190 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-04e6819c-6a1d-4a88-9fde-21127206c5c0 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 1097 time: 0.1239219
May 27 09:33:46.205982 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2eecc4f070>,) {'filters': {'network_id': ['7a08fef5-d013-4fc8-8260-e3fd96453634']}} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:46.223678 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eecc4f070>, '111bd85e-76cc-4ba7-8f48-b8ddd0684287') {'for_net_delete': True} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:46.224230 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eecc4f070>, '111bd85e-76cc-4ba7-8f48-b8ddd0684287') {} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:33:46.243431 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3483835'] for segment, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:46.271885 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:46.287550 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] Releasing vlan 363 on physical network physnet1 to pool {{(pid=91820) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:33:46.288258 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2421763'] for segment, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]: Traceback (most recent call last):
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     timer()
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     cb(*args, **kw)
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     return func(*args, **kwargs)
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     self._notify()
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     self.callback(batched_events)
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     event.method(event)
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     return f(self, *a, **k)
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._get(url).json()
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self.request(url, 'GET', **kwargs)
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:33:46.319952 dv-cinder-772623-6-iscsi neutron-server[91820]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:33:46.326793 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-f1d1c398-deea-4269-a324-542bd60538e4 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9734bd01-bec4-4629-a99e-36b3d4950146 HTTP/1.1" status: 200  len: 217 time: 0.1199236
May 27 09:33:46.415452 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-07cba494-aaca-4bf4-9410-88cf8a5f00e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:46.416914 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-07cba494-aaca-4bf4-9410-88cf8a5f00e9 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0814302
May 27 09:33:46.476270 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38298614-cac7-4f99-a5b6-7820881796a5 req-153e172a-e5ad-496e-a5aa-584a5c8d0f27 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:46.477917 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-38298614-cac7-4f99-a5b6-7820881796a5 req-153e172a-e5ad-496e-a5aa-584a5c8d0f27 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.2108092
May 27 09:33:46.490262 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:46.499568 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:46.528881 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:46.552449 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-38298614-cac7-4f99-a5b6-7820881796a5 req-a816f0a6-0b95-4157-8ea9-35ecc105cfee tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0569143
May 27 09:33:46.552802 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] Pushing event deleted for resources: {'Network': ['ID=7a08fef5-d013-4fc8-8260-e3fd96453634,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:46.558941 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:46.568857 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-258823fb-da2a-48cc-b71c-a0d2ce1070ea admin admin] 10.222.0.30 "DELETE /v2.0/networks/7a08fef5-d013-4fc8-8260-e3fd96453634 HTTP/1.1" status: 204  len: 168 time: 0.6923044
May 27 09:33:46.570178 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-75308b32-64fe-424a-b0ae-ec935ce205d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:46.572256 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-75308b32-64fe-424a-b0ae-ec935ce205d0 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1470373
May 27 09:33:46.762233 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-fc102d42-fb86-45fc-ae99-46996f6e7e93 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1821041
May 27 09:33:46.908170 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55460) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:47.006008 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-a37219a2-174d-4032-b356-b4f7c76dd44a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ea51e621877d47f29b60bce5258df734&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0958469
May 27 09:33:47.010876 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55464) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:33:47.020338 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e93ab9c6-516e-4ea4-b16e-12392fe83509 req-0a692634-bcbe-4392-a52f-819970a1f751 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2472248
May 27 09:33:47.055892 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72fa3198-ffb4-423e-a454-34899171cd04 req-6596e780-2ee7-4182-b0ed-e5a9f9cff0ab tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:47.057591 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72fa3198-ffb4-423e-a454-34899171cd04 req-6596e780-2ee7-4182-b0ed-e5a9f9cff0ab tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 944 time: 0.1330330
May 27 09:33:47.151069 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4009cfc5-ebd3-4f98-bf4b-cb08e1d68596 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:47.212354 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4009cfc5-ebd3-4f98-bf4b-cb08e1d68596 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:47.270668 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72fa3198-ffb4-423e-a454-34899171cd04 req-4f081683-f3f5-4a10-bfe0-5d5e44f004ea tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2030377
May 27 09:33:47.298867 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3959f655-b92e-4c52-82cf-9dd96ac0f011 req-961a0155-5346-454f-99ff-c5177b753a67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:47.300403 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3959f655-b92e-4c52-82cf-9dd96ac0f011 req-961a0155-5346-454f-99ff-c5177b753a67 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 1097 time: 0.2058434
May 27 09:33:47.325723 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4009cfc5-ebd3-4f98-bf4b-cb08e1d68596 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:47.332380 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a953cd66-133d-4f43-8601-b1fa2619abef admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:47.347707 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4009cfc5-ebd3-4f98-bf4b-cb08e1d68596 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=153060e3-7aa0-458d-9022-cda03d192fae,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:47.350847 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4009cfc5-ebd3-4f98-bf4b-cb08e1d68596 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:47.353177 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4009cfc5-ebd3-4f98-bf4b-cb08e1d68596 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:47.354672 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-4009cfc5-ebd3-4f98-bf4b-cb08e1d68596 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/153060e3-7aa0-458d-9022-cda03d192fae HTTP/1.1" status: 204  len: 168 time: 0.3410380
May 27 09:33:47.493494 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3959f655-b92e-4c52-82cf-9dd96ac0f011 req-564ff30d-f28e-4c61-ab7a-0b3161478b02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:47.495487 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3959f655-b92e-4c52-82cf-9dd96ac0f011 req-564ff30d-f28e-4c61-ab7a-0b3161478b02 service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.1872611
May 27 09:33:47.593571 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3959f655-b92e-4c52-82cf-9dd96ac0f011 req-750d05ba-d6b8-42c4-916f-1fb289f2a361 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9734bd01-bec4-4629-a99e-36b3d4950146 HTTP/1.1" status: 200  len: 217 time: 0.0892031
May 27 09:33:47.693575 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3959f655-b92e-4c52-82cf-9dd96ac0f011 req-51da43f7-5ab6-4b4a-8470-69298d33190a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:47.695871 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3959f655-b92e-4c52-82cf-9dd96ac0f011 req-51da43f7-5ab6-4b4a-8470-69298d33190a service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0949566
May 27 09:33:47.724151 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:33:47.798493 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3959f655-b92e-4c52-82cf-9dd96ac0f011 req-8af50519-0298-4021-bbb2-6e93633b08f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:47.800590 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3959f655-b92e-4c52-82cf-9dd96ac0f011 req-8af50519-0298-4021-bbb2-6e93633b08f5 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0979416
May 27 09:33:47.927092 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:47.944356 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'port_id': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'mac_address': 'fa:16:3e:80:f5:fa', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 381, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:33:48.011866 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:48.033219 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:33:48.051448 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:48.056109 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:48.057993 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-f25ccf27-3734-4f4b-9441-fa9abd8b1310 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:48.098387 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3959f655-b92e-4c52-82cf-9dd96ac0f011 req-1c447ad2-5060-48f7-9bff-80cf104323e1 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2866106
May 27 09:33:48.142003 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,revision_number=7']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:48.143801 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22329f98-397c-4add-baf9-dfad3d42a17a req-42179d81-a83f-485c-8348-00a807d1d7e5 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:48.145390 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-22329f98-397c-4add-baf9-dfad3d42a17a req-42179d81-a83f-485c-8348-00a807d1d7e5 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 943 time: 0.3087845
May 27 09:33:48.150170 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.150506 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.150835 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.151783 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.151783 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.152112 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.152279 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.152686 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.153125 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.153501 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.154722 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.155253 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:33:48.160437 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:48.293703 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-22329f98-397c-4add-baf9-dfad3d42a17a req-8a40343a-1c1e-4006-a53d-5d264b58819d tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0966320
May 27 09:33:48.305041 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:33:48.330706 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3959f655-b92e-4c52-82cf-9dd96ac0f011 req-8d459753-950c-42d3-9af3-70b1c59f17cb service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2227211
May 27 09:33:48.525357 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ed65329-a115-4de7-9082-e056c73ff118 req-06841842-424d-4d02-b959-502ce037f10d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:48.527064 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8ed65329-a115-4de7-9082-e056c73ff118 req-06841842-424d-4d02-b959-502ce037f10d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 944 time: 0.0925725
May 27 09:33:48.579858 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8ed65329-a115-4de7-9082-e056c73ff118 req-caabbedd-8402-437f-8d20-6a168f4fcce8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0461950
May 27 09:33:49.517717 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f22346a-ddc9-4eb6-8b10-26c3f729437b req-378eaf78-d0b4-45c1-bfde-645e83e52fab tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:49.519475 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8f22346a-ddc9-4eb6-8b10-26c3f729437b req-378eaf78-d0b4-45c1-bfde-645e83e52fab tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 944 time: 0.0974581
May 27 09:33:49.577357 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8f22346a-ddc9-4eb6-8b10-26c3f729437b req-78688c2d-6ef6-4fcd-9368-7f6bdab6a9e5 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0518396
May 27 09:33:49.740019 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:49.825791 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d8d950b-1fdc-4df8-aca0-0edc79185084 req-bde734b4-fe29-4902-b07a-9f5e9a69cce6 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:49.828400 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6d8d950b-1fdc-4df8-aca0-0edc79185084 req-bde734b4-fe29-4902-b07a-9f5e9a69cce6 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 944 time: 0.1290424
May 27 09:33:49.832130 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:49.832572 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:49.897194 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6d8d950b-1fdc-4df8-aca0-0edc79185084 req-03c3608f-190f-4fa4-920d-0d540e6a665a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0621023
May 27 09:33:50.053268 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:50.096628 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:33:50.110662 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:50.114330 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:50.117446 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:50.164879 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'code': 200}
May 27 09:33:50.219893 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,revision_number=8']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:50.224221 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:50.504019 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98dd034b-6c6c-4b7b-8f88-ae5b36b5e9f1 req-63f748ff-41ef-488b-b6af-7101141a2fd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:50.505643 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-98dd034b-6c6c-4b7b-8f88-ae5b36b5e9f1 req-63f748ff-41ef-488b-b6af-7101141a2fd5 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 1098 time: 0.0882480
May 27 09:33:50.559754 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-98dd034b-6c6c-4b7b-8f88-ae5b36b5e9f1 req-8ff06109-0e18-4ab8-8d6d-d06b750d128c service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0427132
May 27 09:33:50.800585 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d181f2-6766-4611-bc7c-6ac62a2f97b3 req-7379a140-bc54-44e3-b8f1-e3e88b90a191 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:50.802717 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c7d181f2-6766-4611-bc7c-6ac62a2f97b3 req-7379a140-bc54-44e3-b8f1-e3e88b90a191 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.0940242
May 27 09:33:50.857391 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c7d181f2-6766-4611-bc7c-6ac62a2f97b3 req-375d0d4e-eb10-4503-ac6f-e0294af83960 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0475936
May 27 09:33:51.138936 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dbfd6c8-52fe-44c7-a1a1-551893e4df2b req-0a851809-27ce-43c4-afe7-8140c672b631 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:51.140441 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0dbfd6c8-52fe-44c7-a1a1-551893e4df2b req-0a851809-27ce-43c4-afe7-8140c672b631 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 944 time: 0.0967479
May 27 09:33:51.204554 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0dbfd6c8-52fe-44c7-a1a1-551893e4df2b req-409b8b77-0c07-4bb7-9392-2d9f55addf0b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0537555
May 27 09:33:52.076824 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b14c1d-2093-405d-90ad-5a95fb770228 req-a40bfec2-4ba8-4a38-bdac-94914ed5ab96 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:52.078475 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-65b14c1d-2093-405d-90ad-5a95fb770228 req-a40bfec2-4ba8-4a38-bdac-94914ed5ab96 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.0923371
May 27 09:33:52.133544 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-65b14c1d-2093-405d-90ad-5a95fb770228 req-22e1f8c8-beb7-457c-8ca3-7bd92c5a18e1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430861
May 27 09:33:52.426015 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea6d1291-3c9e-48f2-84bf-ffa06e2b3a2c req-212a4cd4-7260-4bbc-bb81-3fa9e29c3893 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:52.427630 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ea6d1291-3c9e-48f2-84bf-ffa06e2b3a2c req-212a4cd4-7260-4bbc-bb81-3fa9e29c3893 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 944 time: 0.0896044
May 27 09:33:52.480460 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ea6d1291-3c9e-48f2-84bf-ffa06e2b3a2c req-913ff64b-62c1-493d-8c7c-68e21402ceac tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0441930
May 27 09:33:53.835736 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-123b2ed4-a537-43bc-9220-9ee85c7b32de req-447c7f24-f30c-4729-beb0-c9e484906634 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:53.838443 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-123b2ed4-a537-43bc-9220-9ee85c7b32de req-447c7f24-f30c-4729-beb0-c9e484906634 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 944 time: 0.2217748
May 27 09:33:53.913567 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-123b2ed4-a537-43bc-9220-9ee85c7b32de req-eabca95c-4e76-42db-9c41-903d731ac1c3 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0673461
May 27 09:33:55.197829 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-062ad76c-a85d-4b85-8eb9-80f0d00cbf73 req-6c3231cd-38b7-4163-9161-e8bcbc9865b7 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:55.199327 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-062ad76c-a85d-4b85-8eb9-80f0d00cbf73 req-6c3231cd-38b7-4163-9161-e8bcbc9865b7 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 944 time: 0.1452103
May 27 09:33:55.257252 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-062ad76c-a85d-4b85-8eb9-80f0d00cbf73 req-bec56645-73b8-4c26-bb19-ea501b634343 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0508924
May 27 09:33:55.766887 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9734bd01-bec4-4629-a99e-36b3d4950146 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:33:55.983703 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9734bd01-bec4-4629-a99e-36b3d4950146, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9734bd01-bec4-4629-a99e-36b3d4950146,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:56.004518 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '9734bd01-bec4-4629-a99e-36b3d4950146', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'port_id': '9734bd01-bec4-4629-a99e-36b3d4950146', 'mac_address': 'fa:16:3e:0b:21:4b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 393, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:33:56.066903 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:56.085155 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9734bd01-bec4-4629-a99e-36b3d4950146 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:33:56.112464 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9734bd01-bec4-4629-a99e-36b3d4950146, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9734bd01-bec4-4629-a99e-36b3d4950146,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:56.120739 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:56.123574 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:56.253337 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=9734bd01-bec4-4629-a99e-36b3d4950146,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:56.265318 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.142s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:56.363502 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['9734bd01-bec4-4629-a99e-36b3d4950146'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:33:56.521284 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:56.655398 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b6720dc-a971-4823-b9cb-f19542987c04 req-c5925652-5706-4f67-bf1d-628d413d3101 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:56.657198 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0b6720dc-a971-4823-b9cb-f19542987c04 req-c5925652-5706-4f67-bf1d-628d413d3101 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 945 time: 0.1461661
May 27 09:33:56.750539 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0b6720dc-a971-4823-b9cb-f19542987c04 req-997c631e-0ecc-4d66-835c-f06d439dbf94 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0762756
May 27 09:33:57.781558 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9734bd01-bec4-4629-a99e-36b3d4950146 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:33:57.856384 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 9734bd01-bec4-4629-a99e-36b3d4950146 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:33:57.861900 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 9734bd01-bec4-4629-a99e-36b3d4950146 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:33:57.862286 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:58.001326 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:58.029005 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea26d626-49e2-410c-b9ca-d8b5a3e0fd77 req-889c2c1d-32e3-454e-8f79-2b1882f5ae2d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:58.030863 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ea26d626-49e2-410c-b9ca-d8b5a3e0fd77 req-889c2c1d-32e3-454e-8f79-2b1882f5ae2d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 945 time: 0.1484692
May 27 09:33:58.049017 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '833aa915-b338-444b-b501-e9dac73b7858', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9734bd01-bec4-4629-a99e-36b3d4950146'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:33:58.068104 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9734bd01-bec4-4629-a99e-36b3d4950146, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9734bd01-bec4-4629-a99e-36b3d4950146,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:33:58.074715 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:33:58.080039 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:33:58.105497 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ea26d626-49e2-410c-b9ca-d8b5a3e0fd77 req-1c514138-9fbd-40a6-aa16-c2e73cbcfcd1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0632253
May 27 09:33:58.219401 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=9734bd01-bec4-4629-a99e-36b3d4950146,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:33:58.223258 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:33:58.244396 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '833aa915-b338-444b-b501-e9dac73b7858', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9734bd01-bec4-4629-a99e-36b3d4950146', 'code': 200}
May 27 09:33:58.390915 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-439739c1-646a-49b7-9647-968e5ff7515d req-190dd7e5-c2cf-4b88-8306-6fa66ef604fc tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:58.393063 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-439739c1-646a-49b7-9647-968e5ff7515d req-190dd7e5-c2cf-4b88-8306-6fa66ef604fc tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.0866187
May 27 09:33:58.443436 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-439739c1-646a-49b7-9647-968e5ff7515d req-4682500d-7be9-40bc-b68b-38139dfee326 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0441062
May 27 09:33:58.645950 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a15cea2-3166-4855-aa2a-98d315fc17ee req-73be1441-91b9-4074-9317-9b395fb7b705 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:58.648581 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4a15cea2-3166-4855-aa2a-98d315fc17ee req-73be1441-91b9-4074-9317-9b395fb7b705 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 1099 time: 0.0979228
May 27 09:33:58.693867 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4a15cea2-3166-4855-aa2a-98d315fc17ee req-17ea30bb-778e-46e2-b9cd-56a2658f2e0b service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389709
May 27 09:33:59.329169 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d42e94a-b8a9-4e03-a51a-7bc8ddabcc59 req-01b1fc21-cc57-4313-87f5-a71a3b1d9b44 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:59.330763 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9d42e94a-b8a9-4e03-a51a-7bc8ddabcc59 req-01b1fc21-cc57-4313-87f5-a71a3b1d9b44 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 946 time: 0.0821729
May 27 09:33:59.382132 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9d42e94a-b8a9-4e03-a51a-7bc8ddabcc59 req-d0c4de56-cada-4ef2-8b7e-218d8df21a9f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0453556
May 27 09:33:59.673581 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ff087e-ef3b-464e-a93c-ae256dc2bfe5 req-f6c4ead9-077e-4fb5-a1df-9a3cea5adc72 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:33:59.675186 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-38ff087e-ef3b-464e-a93c-ae256dc2bfe5 req-f6c4ead9-077e-4fb5-a1df-9a3cea5adc72 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.1024637
May 27 09:33:59.726798 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-38ff087e-ef3b-464e-a93c-ae256dc2bfe5 req-59ff23f1-0dff-428a-b9a6-03c3ae736e81 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0445056
May 27 09:34:00.591925 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28b373c7-9cd0-421b-b727-e17080e8c12b req-d2898997-cd35-4176-a1e4-a4d550ee00ed tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:00.593619 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-28b373c7-9cd0-421b-b727-e17080e8c12b req-d2898997-cd35-4176-a1e4-a4d550ee00ed tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 946 time: 0.0955484
May 27 09:34:00.650246 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-28b373c7-9cd0-421b-b727-e17080e8c12b req-cb4abed9-36ff-4b27-b51e-1714520920e3 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0462751
May 27 09:34:00.959874 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8be3e8ca-dbac-4508-be88-22fe89aab0e8 req-c58f8145-4844-43b0-9a49-1b60b96b62d8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:00.961498 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8be3e8ca-dbac-4508-be88-22fe89aab0e8 req-c58f8145-4844-43b0-9a49-1b60b96b62d8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 946 time: 0.1926010
May 27 09:34:00.996347 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559b500c-544a-47af-b5e0-0cf0ec412f8c req-263982b7-a96d-4fe6-aae8-fc8f38a7e639 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:00.998765 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-559b500c-544a-47af-b5e0-0cf0ec412f8c req-263982b7-a96d-4fe6-aae8-fc8f38a7e639 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.1483119
May 27 09:34:01.055439 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8be3e8ca-dbac-4508-be88-22fe89aab0e8 req-6b85e8f0-61d8-44dc-9a2b-692d918db7b1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0861139
May 27 09:34:01.070932 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-559b500c-544a-47af-b5e0-0cf0ec412f8c req-4b8daa1a-f1dd-4258-ae9c-73196800cf44 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0639014
May 27 09:34:01.088401 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55590) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:01.427699 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0471f7d1-fcb1-4f38-8509-3d612d1b1c3f tempest-TestVolumeBootPattern-1068691054 tempest-TestVolumeBootPattern-1068691054-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:01.429375 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-0471f7d1-fcb1-4f38-8509-3d612d1b1c3f tempest-TestVolumeBootPattern-1068691054 tempest-TestVolumeBootPattern-1068691054-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 1094 time: 0.3399947
May 27 09:34:01.432299 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55596) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:01.438092 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'floatingip': {'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'port_id': '9734bd01-bec4-4629-a99e-36b3d4950146', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address': '172.20.0.13'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:34:01.445184 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:34:01.449620 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:floatingip and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:34:01.452889 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:34:01.459191 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:34:01.471853 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:01.620203 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:01.779816 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Allocated IP 172.27.1.119 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/05fdf8ce-5197-4ba6-8905-54270d7b3721) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:34:01.958474 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:01.993262 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:02.005305 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:02.111439 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:34:02.115677 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:34:02.119864 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:34:02.215033 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'Port': ['ID=05fdf8ce-5197-4ba6-8905-54270d7b3721,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:02.221072 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:02.301523 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f53e5b8b-856e-43cf-b0ac-4b6005dc1645 req-2bfada9a-c63f-41f2-b9c3-1a3cd68d168b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:02.303231 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f53e5b8b-856e-43cf-b0ac-4b6005dc1645 req-2bfada9a-c63f-41f2-b9c3-1a3cd68d168b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.0916812
May 27 09:34:02.359137 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f53e5b8b-856e-43cf-b0ac-4b6005dc1645 req-cb2a5aa9-3a55-45a6-ac2d-db8a66215d58 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0497143
May 27 09:34:02.814484 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:02.900849 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:03.190608 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:03.197211 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:03.204532 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0e7b303c-d47a-4fb9-b96f-8937659b6db1 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:03.328040 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'Port': ['ID=05fdf8ce-5197-4ba6-8905-54270d7b3721,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:03.332566 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:03.343737 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:03.542291 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.l3_db [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Floating IP fc0f0f43-cc17-42cb-a998-b0842de1fdeb associated. External IP: 172.27.1.119, port: 9734bd01-bec4-4629-a99e-36b3d4950146.
May 27 09:34:03.702712 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e961d13-4958-483a-bb1e-cb54ff4b656a req-b84606b0-8218-4294-bea4-284e1fbbeb74 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:03.705508 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5e961d13-4958-483a-bb1e-cb54ff4b656a req-b84606b0-8218-4294-bea4-284e1fbbeb74 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.1595743
May 27 09:34:03.789319 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5e961d13-4958-483a-bb1e-cb54ff4b656a req-8008bd3f-1e0a-4fdd-9d8d-3d605e2915e0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0764430
May 27 09:34:03.940540 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:34:04.181412 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:34:04.195119 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b603cd0-55ab-4b4a-bfc7-ac23b8cda996 None None] Sync routers for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:34:04.211045 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b603cd0-55ab-4b4a-bfc7-ac23b8cda996 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:34:04.212109 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-1b603cd0-55ab-4b4a-bfc7-ac23b8cda996 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eedade520>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:33:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:04.225465 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:04.327473 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.8854043
May 27 09:34:04.327473 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '833aa915-b338-444b-b501-e9dac73b7858', 'tag': '9734bd01-bec4-4629-a99e-36b3d4950146'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:34:04.407855 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '833aa915-b338-444b-b501-e9dac73b7858', 'tag': '9734bd01-bec4-4629-a99e-36b3d4950146', 'status': 'completed', 'code': 200}
May 27 09:34:04.463195 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-1b603cd0-55ab-4b4a-bfc7-ac23b8cda996 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:34:04.523887 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ed455c2-961a-4c04-a57c-922657379718 req-48879065-ab17-4e51-a767-f582957356e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:04.525316 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ed455c2-961a-4c04-a57c-922657379718 req-48879065-ab17-4e51-a767-f582957356e6 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 1099 time: 0.0843618
May 27 09:34:04.682389 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ed455c2-961a-4c04-a57c-922657379718 req-bac5d2df-a06d-45ba-bd83-c3c91ad720c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:04.683915 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ed455c2-961a-4c04-a57c-922657379718 req-bac5d2df-a06d-45ba-bd83-c3c91ad720c7 service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.1510422
May 27 09:34:04.831313 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ed455c2-961a-4c04-a57c-922657379718 req-70a7646d-18d3-430a-8967-a8a0407281ec service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9734bd01-bec4-4629-a99e-36b3d4950146 HTTP/1.1" status: 200  len: 1000 time: 0.1403286
May 27 09:34:04.952520 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ed455c2-961a-4c04-a57c-922657379718 req-701ac444-5534-403e-a9b2-db8d515b3f52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:04.954976 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ed455c2-961a-4c04-a57c-922657379718 req-701ac444-5534-403e-a9b2-db8d515b3f52 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.1169510
May 27 09:34:04.964128 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-1b603cd0-55ab-4b4a-bfc7-ac23b8cda996 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eedade520>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': 'fc0f0f43-cc17-42cb-a998-b0842de1fdeb', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.119', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '9734bd01-bec4-4629-a99e-36b3d4950146', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:0b:21:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '833aa915-b338-444b-b501-e9dac73b7858', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:34:02Z', 'updated_at': '2021-05-27T09:34:02Z', 'revision_number': 0, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:04.970999 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b603cd0-55ab-4b4a-bfc7-ac23b8cda996 None None] Checking router: 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:34:04.980850 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b603cd0-55ab-4b4a-bfc7-ac23b8cda996 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:34:04.981496 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-1b603cd0-55ab-4b4a-bfc7-ac23b8cda996 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eedade520>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:33:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:05.203294 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee55e3e-e6d2-43fd-a75e-cdcf60aa77d9 req-e745c2a9-2caf-4542-9f95-9a19cd29256d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:05.204809 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dee55e3e-e6d2-43fd-a75e-cdcf60aa77d9 req-e745c2a9-2caf-4542-9f95-9a19cd29256d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.2416520
May 27 09:34:05.210089 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ed455c2-961a-4c04-a57c-922657379718 req-5e17e463-d5f0-4e38-a4a8-7b02601b1797 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:05.211599 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ed455c2-961a-4c04-a57c-922657379718 req-5e17e463-d5f0-4e38-a4a8-7b02601b1797 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.2147517
May 27 09:34:05.255807 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-1b603cd0-55ab-4b4a-bfc7-ac23b8cda996 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:34:05.391293 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dee55e3e-e6d2-43fd-a75e-cdcf60aa77d9 req-24d9ff4a-3823-4382-bf6c-ff36e3972858 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1724153
May 27 09:34:05.447028 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ed455c2-961a-4c04-a57c-922657379718 req-ee20de14-9aad-49e8-ba7d-0d63adb15003 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2257915
May 27 09:34:05.604693 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6ed455c2-961a-4c04-a57c-922657379718 req-ef367512-ca14-44fb-b32c-58d0858046c2 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1452191
May 27 09:34:05.889713 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-1b603cd0-55ab-4b4a-bfc7-ac23b8cda996 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eedade520>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': 'fc0f0f43-cc17-42cb-a998-b0842de1fdeb', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.119', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '9734bd01-bec4-4629-a99e-36b3d4950146', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:0b:21:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '833aa915-b338-444b-b501-e9dac73b7858', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:34:02Z', 'updated_at': '2021-05-27T09:34:02Z', 'revision_number': 0, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:05.895704 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b603cd0-55ab-4b4a-bfc7-ac23b8cda996 None None] The sync data for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi is: [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': 'fc0f0f43-cc17-42cb-a998-b0842de1fdeb', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.119', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '9734bd01-bec4-4629-a99e-36b3d4950146', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:0b:21:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '833aa915-b338-444b-b501-e9dac73b7858', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:34:02Z', 'updated_at': '2021-05-27T09:34:02Z', 'revision_number': 0, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:34:06.110866 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-509fc2b9-d5a6-457f-b4dc-23e575383d4f None None] New status for floating IP fc0f0f43-cc17-42cb-a998-b0842de1fdeb: ACTIVE {{(pid=91823) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:34:06.613246 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-346fdb06-83ad-4420-90ee-c6595e46292a req-d127a11f-a412-4de1-9fb7-a9b4dbaaae5e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:06.614924 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-346fdb06-83ad-4420-90ee-c6595e46292a req-d127a11f-a412-4de1-9fb7-a9b4dbaaae5e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.0881045
May 27 09:34:06.671282 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-346fdb06-83ad-4420-90ee-c6595e46292a req-0062d8aa-73f6-4d27-8c50-7fb5013065e4 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0502515
May 27 09:34:07.886549 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e34b9a4d-a47f-4a06-8996-6a0755787fc6 req-e13b2891-11c8-40c2-b3e9-f31a1024f2cd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:07.888585 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e34b9a4d-a47f-4a06-8996-6a0755787fc6 req-e13b2891-11c8-40c2-b3e9-f31a1024f2cd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.0896549
May 27 09:34:07.933641 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e34b9a4d-a47f-4a06-8996-6a0755787fc6 req-4e79b259-0244-421f-ab3e-a8e978f94d0d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0391214
May 27 09:34:08.494301 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-50661184-ed04-4fbf-837c-00264af13881 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:09.136466 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-149cd64c-9849-4dda-9d73-3de13866030b req-ac7a6734-7236-4d20-99bc-2f83b7583bdf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:09.138306 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-149cd64c-9849-4dda-9d73-3de13866030b req-ac7a6734-7236-4d20-99bc-2f83b7583bdf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.0910740
May 27 09:34:09.189639 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-149cd64c-9849-4dda-9d73-3de13866030b req-301ad1c2-b37f-4f52-b038-3b0fa9dab2fd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0447450
May 27 09:34:09.829257 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device bd7e74f7-d502-4ed5-b38d-566afcb0be1a details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:34:09.977662 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:09.995169 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'port_id': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'mac_address': 'fa:16:3e:45:6e:69', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 396, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:34:10.060186 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:10.078671 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id bd7e74f7-d502-4ed5-b38d-566afcb0be1a {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:34:10.097203 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:10.101885 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:10.104319 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-c30aa56e-48df-4910-a11f-b45f4a030c23 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:10.181889 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,revision_number=6']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:10.187267 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:10.198285 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['bd7e74f7-d502-4ed5-b38d-566afcb0be1a'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:34:10.551492 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f6d664a-68ee-47b2-b710-1203050cd548 req-bd8746ec-4ca6-4495-8102-1c0241af576f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:10.554022 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1f6d664a-68ee-47b2-b710-1203050cd548 req-bd8746ec-4ca6-4495-8102-1c0241af576f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 944 time: 0.1708035
May 27 09:34:10.605319 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1f6d664a-68ee-47b2-b710-1203050cd548 req-ad0c7fc6-653c-4476-9d43-4a18714e3fe0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0456402
May 27 09:34:11.452479 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:11.827058 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a155108e-1838-42ff-aed6-9adb5b0edfd7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:11.837631 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9e456a7-d013-4f92-8062-1fb0eef51b9a req-4144295e-94be-4b34-9ecb-7b50a02131c0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:11.840631 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f9e456a7-d013-4f92-8062-1fb0eef51b9a req-4144295e-94be-4b34-9ecb-7b50a02131c0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 944 time: 0.1083186
May 27 09:34:11.846882 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device bd7e74f7-d502-4ed5-b38d-566afcb0be1a up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:34:11.907917 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f9e456a7-d013-4f92-8062-1fb0eef51b9a req-f7952caa-bf04-4431-8754-123d56f4ffc8 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0595181
May 27 09:34:11.959529 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port bd7e74f7-d502-4ed5-b38d-566afcb0be1a triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:34:11.960232 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:12.148389 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:12.199352 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:34:12.217517 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:12.225868 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:12.230789 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:12.293090 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'code': 200}
May 27 09:34:12.391218 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,revision_number=7']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:12.398583 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:12.408719 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:13.208462 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd589037-049e-4dc3-a071-59e9fdaf4c92 req-0724fa4a-370d-4660-8322-1d1bf22113fa tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:13.217373 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cd589037-049e-4dc3-a071-59e9fdaf4c92 req-0724fa4a-370d-4660-8322-1d1bf22113fa tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.1509006
May 27 09:34:13.277339 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cd589037-049e-4dc3-a071-59e9fdaf4c92 req-35628ebc-dc24-4fc7-82e3-c80635c56a27 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0587540
May 27 09:34:14.697135 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5805ce6c-bc36-4cf3-bc90-04b10a4e1671 req-4c700417-5762-49bc-87f7-acd03d983f9f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:14.718881 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5805ce6c-bc36-4cf3-bc90-04b10a4e1671 req-4c700417-5762-49bc-87f7-acd03d983f9f tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.2085276
May 27 09:34:14.798119 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5805ce6c-bc36-4cf3-bc90-04b10a4e1671 req-7b0974ae-ebf1-4859-9a45-32381e7bc10d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0775361
May 27 09:34:14.928366 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:16.073212 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ca44ad-da6d-4192-b105-4c790e595c36 req-0f19bf19-1a0f-499e-a97e-674830698ec7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:16.076854 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-07ca44ad-da6d-4192-b105-4c790e595c36 req-0f19bf19-1a0f-499e-a97e-674830698ec7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.1177361
May 27 09:34:16.158143 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-07ca44ad-da6d-4192-b105-4c790e595c36 req-fad95b42-9322-4910-b88c-10ac8dd9e11b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0743287
May 27 09:34:17.547081 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c07254f-31ae-4db2-b88f-00f0e0fa8cb9 req-46d5cfaa-56ae-44fd-a56a-e2d8f43f2529 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:17.548760 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2c07254f-31ae-4db2-b88f-00f0e0fa8cb9 req-46d5cfaa-56ae-44fd-a56a-e2d8f43f2529 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.1546669
May 27 09:34:17.650782 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2c07254f-31ae-4db2-b88f-00f0e0fa8cb9 req-14735274-79b6-4516-b692-52e4122871f6 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0916762
May 27 09:34:18.939716 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be13cb77-a203-4c3b-93f8-8c08e351ea36 req-8d8b92a1-d38a-408d-84fe-dea2fed5f634 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:18.942192 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-be13cb77-a203-4c3b-93f8-8c08e351ea36 req-8d8b92a1-d38a-408d-84fe-dea2fed5f634 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.1472735
May 27 09:34:19.038427 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-be13cb77-a203-4c3b-93f8-8c08e351ea36 req-0442425d-5d76-47ca-90f7-7dba67119135 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0832601
May 27 09:34:20.133015 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:34:20.525909 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0f6a5a7-d828-4c26-8832-6a793503411d req-fe47fea8-96e3-45c8-9a55-7a2d504ef02d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:20.531814 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a0f6a5a7-d828-4c26-8832-6a793503411d req-fe47fea8-96e3-45c8-9a55-7a2d504ef02d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.2121003
May 27 09:34:20.648937 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a0f6a5a7-d828-4c26-8832-6a793503411d req-bff53d99-2832-47a5-9c49-565bc79bebe3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1047893
May 27 09:34:21.164595 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c298838-b31e-43eb-bc40-f4f9c98d7f6d req-c0b7b586-374b-4cec-b848-26366282df22 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:21.170097 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8c298838-b31e-43eb-bc40-f4f9c98d7f6d req-c0b7b586-374b-4cec-b848-26366282df22 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 946 time: 0.2190681
May 27 09:34:21.233380 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8c298838-b31e-43eb-bc40-f4f9c98d7f6d req-43c2078b-8636-4d1d-b72c-44240dfb6148 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0538909
May 27 09:34:22.145267 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3d50895-253c-4745-93f1-62f51f747502 req-8ffa25cb-27ca-4b33-86f8-812c2cc456a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:22.152110 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d3d50895-253c-4745-93f1-62f51f747502 req-8ffa25cb-27ca-4b33-86f8-812c2cc456a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.1185157
May 27 09:34:22.208124 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d3d50895-253c-4745-93f1-62f51f747502 req-d0cfc84d-84ef-4e3b-be6e-a48b1ad16f56 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0517404
May 27 09:34:22.530249 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76ff310-3788-400f-94a4-3ae470b61593 req-52496c3c-c9bb-4635-92c3-6082bdf8db51 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:22.543434 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d76ff310-3788-400f-94a4-3ae470b61593 req-52496c3c-c9bb-4635-92c3-6082bdf8db51 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 946 time: 0.1745925
May 27 09:34:22.634360 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d76ff310-3788-400f-94a4-3ae470b61593 req-996f170f-56e4-49b1-b986-91a137652094 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0888224
May 27 09:34:23.034035 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-250a64ef-97ad-4e37-b59f-2594450282ce tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:23.036659 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-250a64ef-97ad-4e37-b59f-2594450282ce tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.11 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 946 time: 0.2849870
May 27 09:34:23.307922 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Deleting port 524ba62d-2814-4825-b3ab-2f96c42b5a0c {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:34:23.308984 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:23.549511 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] For port 524ba62d-2814-4825-b3ab-2f96c42b5a0c, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=524ba62d-2814-4825-b3ab-2f96c42b5a0c,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:23.549838 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:23.628960 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99533e99-fe38-4ee5-86da-7fc081249df0 req-88eaab95-bdb2-475d-bbe0-a99c255c1bcd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:23.630411 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-99533e99-fe38-4ee5-86da-7fc081249df0 req-88eaab95-bdb2-475d-bbe0-a99c255c1bcd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.2209988
May 27 09:34:23.784306 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-99533e99-fe38-4ee5-86da-7fc081249df0 req-f591c097-00f9-41d1-a6de-cbf13991ca9c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1440661
May 27 09:34:24.077475 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:24.080082 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:24.080082 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.l3_db [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Floating IP 6771cfad-a218-4624-a012-a32dc1beb21d disassociated. External IP: 172.27.1.212, port: 524ba62d-2814-4825-b3ab-2f96c42b5a0c.
May 27 09:34:24.080082 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Calling delete_port for 524ba62d-2814-4825-b3ab-2f96c42b5a0c owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:34:24.123251 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acc6159b-d594-4cb5-ae03-5096a8914d0e req-16c5f24b-3077-4892-890b-03a3b3dc6039 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:24.126137 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-acc6159b-d594-4cb5-ae03-5096a8914d0e req-16c5f24b-3077-4892-890b-03a3b3dc6039 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 946 time: 0.3065794
May 27 09:34:24.199862 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-acc6159b-d594-4cb5-ae03-5096a8914d0e req-1c7ea0ca-170e-46c6-82e1-da4b642d5d85 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups?id=678d7678-18e3-4d7c-aecd-a992255c87ef&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0585489
May 27 09:34:24.289692 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:24.295624 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-b8efcd9e-1e88-42d0-9dfc-56614d95c110 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:24.343469 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event deleted for resources: {'Port': ['ID=524ba62d-2814-4825-b3ab-2f96c42b5a0c,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:24.354372 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.354839 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.355081 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.355454 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.355814 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.356212 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.356641 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.357193 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.357676 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.358032 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.358395 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.358741 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:24.419618 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:24.562444 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Router ad64253e-1ce7-4c03-90db-1073e41e8e5f has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:34:24.776769 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:34:24.787657 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ad01b22-2368-456f-85a2-8156b3e15760 None None] Sync routers for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:34:24.804364 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ad01b22-2368-456f-85a2-8156b3e15760 None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:34:24.805014 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-5ad01b22-2368-456f-85a2-8156b3e15760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eeceef5e0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:34:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:24.863972 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] No DVR routers for this DVR port 524ba62d-2814-4825-b3ab-2f96c42b5a0c on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:34:24.866938 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:24.879359 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'name': 'network-vif-deleted', 'tag': '524ba62d-2814-4825-b3ab-2f96c42b5a0c'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:34:24.887086 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d0da8a6f-92be-44aa-894d-b7829cb9fba9 req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.11 "DELETE /v2.0/ports/524ba62d-2814-4825-b3ab-2f96c42b5a0c HTTP/1.1" status: 204  len: 173 time: 1.8413000
May 27 09:34:24.976770 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f1158481-e335-4847-863a-a2b85c5cbfbb', 'name': 'network-vif-deleted', 'tag': '524ba62d-2814-4825-b3ab-2f96c42b5a0c', 'status': 'completed', 'code': 200}
May 27 09:34:25.042044 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-5ad01b22-2368-456f-85a2-8156b3e15760 None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:34:25.191846 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e4d9bf2-bc91-432f-a711-7cc2d4ba0b94 req-1c1159bb-5b25-42aa-9f7e-ae32954a66fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:25.193277 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2e4d9bf2-bc91-432f-a711-7cc2d4ba0b94 req-1c1159bb-5b25-42aa-9f7e-ae32954a66fd service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 1098 time: 0.2104573
May 27 09:34:25.200944 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b95ba2a7-5113-41ee-88d2-2b75771a9a27 req-aa7fa6bc-920e-4ac3-95ec-539e11b80368 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:25.202361 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b95ba2a7-5113-41ee-88d2-2b75771a9a27 req-aa7fa6bc-920e-4ac3-95ec-539e11b80368 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 945 time: 0.2740486
May 27 09:34:25.394275 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b95ba2a7-5113-41ee-88d2-2b75771a9a27 req-0ea17d95-4a69-436f-80c8-284f8b3a59b2 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1620605
May 27 09:34:25.403602 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-74f33cdd-d600-4f98-8df0-a9fa5e8fa21c req-0e247110-2629-4a91-bd03-3d97d976001a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Synchronizing usage tracker for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:34:25.434877 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-74f33cdd-d600-4f98-8df0-a9fa5e8fa21c req-0e247110-2629-4a91-bd03-3d97d976001a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Unset dirty status for tenant:3b2fb81840c64238b0ae0db08ca9b139 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:34:25.436814 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-74f33cdd-d600-4f98-8df0-a9fa5e8fa21c req-0e247110-2629-4a91-bd03-3d97d976001a tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/ports?device_id=f1158481-e335-4847-863a-a2b85c5cbfbb HTTP/1.1" status: 200  len: 210 time: 0.1012659
May 27 09:34:25.438746 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-5ad01b22-2368-456f-85a2-8156b3e15760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eeceef5e0>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:25.444769 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ad01b22-2368-456f-85a2-8156b3e15760 None None] Checking router: ad64253e-1ce7-4c03-90db-1073e41e8e5f for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:34:25.448857 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e4d9bf2-bc91-432f-a711-7cc2d4ba0b94 req-6cf40e65-0b88-412e-b8ef-00ed4b098988 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:25.451655 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2e4d9bf2-bc91-432f-a711-7cc2d4ba0b94 req-6cf40e65-0b88-412e-b8ef-00ed4b098988 service neutron] 10.222.0.11 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 917 time: 0.2460403
May 27 09:34:25.461829 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5ad01b22-2368-456f-85a2-8156b3e15760 None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:34:25.461829 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-5ad01b22-2368-456f-85a2-8156b3e15760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eeceef5e0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:34:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:25.578068 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2e4d9bf2-bc91-432f-a711-7cc2d4ba0b94 req-4c39965e-2cb7-4508-a298-22df10f94574 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a HTTP/1.1" status: 200  len: 1000 time: 0.1144617
May 27 09:34:25.652264 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e4d9bf2-bc91-432f-a711-7cc2d4ba0b94 req-9a475d60-699e-4fbc-bf98-3f735f017215 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:25.654456 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2e4d9bf2-bc91-432f-a711-7cc2d4ba0b94 req-9a475d60-699e-4fbc-bf98-3f735f017215 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 200  len: 855 time: 0.0625751
May 27 09:34:25.679219 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-5ad01b22-2368-456f-85a2-8156b3e15760 None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:34:25.750805 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e4d9bf2-bc91-432f-a711-7cc2d4ba0b94 req-9c686dc9-77a6-4aaf-ae2c-bffc564d5dc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:25.752343 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2e4d9bf2-bc91-432f-a711-7cc2d4ba0b94 req-9c686dc9-77a6-4aaf-ae2c-bffc564d5dc8 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=624aa867-a71e-4343-8899-4e49257cd000&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0899165
May 27 09:34:25.925457 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2e4d9bf2-bc91-432f-a711-7cc2d4ba0b94 req-e41f11fc-8374-467b-b1a7-78dca018ca5b service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1580780
May 27 09:34:25.972087 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device bd7e74f7-d502-4ed5-b38d-566afcb0be1a no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:34:26.097694 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2e4d9bf2-bc91-432f-a711-7cc2d4ba0b94 req-5cd83b6b-89cc-4ae0-abe6-3c76e6706dac service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1634846
May 27 09:34:26.142415 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-5ad01b22-2368-456f-85a2-8156b3e15760 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eeceef5e0>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:26.144601 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:26.161906 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5ad01b22-2368-456f-85a2-8156b3e15760 None None] The sync data for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi is: [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:27:16Z', 'revision_number': 4, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'b018c078-86c3-4e4a-bd90-fa725cdd3369', 'name': '', 'network_id': 'bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'mac_address': 'fa:16:3e:41:5c:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_interface', 'standard_attr_id': 96, 'fixed_ips': [{'subnet_id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:12Z', 'updated_at': '2021-05-27T09:27:37Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'subnets': [{'id': 'b2c650ce-3329-4545-aaac-c69109472b2b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:34:26.178939 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:34:26.190055 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:26.195616 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:26.196806 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 524ba62d-2814-4825-b3ab-2f96c42b5a0c no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:34:26.221373 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:26.257855 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'code': 200}
May 27 09:34:26.282371 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 524ba62d-2814-4825-b3ab-2f96c42b5a0c {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:34:26.282650 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 524ba62d-2814-4825-b3ab-2f96c42b5a0c not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:34:26.308011 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,revision_number=8']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:26.312617 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:26.411725 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe96df18-0fd5-4005-a0d5-80cf275080d5 None None] New status for floating IP 6771cfad-a218-4624-a012-a32dc1beb21d: DOWN {{(pid=91823) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:34:26.421490 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:26.601898 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55796) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:26.724411 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-27586c8e-856f-4b14-87b3-3534191a0d30 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:26.768228 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3fdcc3b-33ce-40c0-94b1-4830fa0c8b7a req-d0cb2a2b-188a-40af-8440-e50f1feda6f9 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:26.770838 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d3fdcc3b-33ce-40c0-94b1-4830fa0c8b7a req-d0cb2a2b-188a-40af-8440-e50f1feda6f9 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.1447954
May 27 09:34:26.773583 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-27586c8e-856f-4b14-87b3-3534191a0d30 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:26.827995 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d3fdcc3b-33ce-40c0-94b1-4830fa0c8b7a req-c59c1974-a74a-4f9e-bcbb-6a049c1c9731 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0506697
May 27 09:34:26.879799 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-27586c8e-856f-4b14-87b3-3534191a0d30 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:26.885171 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1989e412-9e23-4472-bcc4-0e92ef4020e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:27.026432 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27586c8e-856f-4b14-87b3-3534191a0d30 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=678d7678-18e3-4d7c-aecd-a992255c87ef,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:27.029635 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-27586c8e-856f-4b14-87b3-3534191a0d30 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:27.040887 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-27586c8e-856f-4b14-87b3-3534191a0d30 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:27.042508 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-27586c8e-856f-4b14-87b3-3534191a0d30 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "DELETE /v2.0/security-groups/678d7678-18e3-4d7c-aecd-a992255c87ef HTTP/1.1" status: 204  len: 168 time: 0.4390717
May 27 09:34:27.046395 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55800) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:27.070090 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.api.v2.resource [None req-0d52268e-38a9-4d42-811a-ff86e4b5a095 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] show failed (client error): The resource could not be found.
May 27 09:34:27.071478 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-0d52268e-38a9-4d42-811a-ff86e4b5a095 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "GET /v2.0/security-groups/678d7678-18e3-4d7c-aecd-a992255c87ef HTTP/1.1" status: 404  len: 347 time: 0.0238340
May 27 09:34:27.074487 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55804) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:27.314765 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Deleting port 02a9fc00-2d05-4d82-9153-0ec69147825b {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:34:27.315196 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:27.445619 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:27.446004 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:27.586048 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Calling delete_port for 02a9fc00-2d05-4d82-9153-0ec69147825b owned by network:floatingip {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:34:27.746261 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:27.756430 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0e323a04-7091-4aad-8112-768480df15a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:27.851858 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Pushing event deleted for resources: {'Port': ['ID=02a9fc00-2d05-4d82-9153-0ec69147825b,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:27.857692 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:28.002853 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks [] for floatingip, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:28.033121 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:28.034931 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] 10.222.0.30 "DELETE /v2.0/floatingips/6771cfad-a218-4624-a012-a32dc1beb21d HTTP/1.1" status: 204  len: 168 time: 0.9591217
May 27 09:34:28.089394 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da3ce652-a8cf-4020-92e7-8e7ea2b6b7c3 req-31569c98-b723-4b3f-a373-5694e8792c56 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:28.092655 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-da3ce652-a8cf-4020-92e7-8e7ea2b6b7c3 req-31569c98-b723-4b3f-a373-5694e8792c56 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.1088665
May 27 09:34:28.183246 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-da3ce652-a8cf-4020-92e7-8e7ea2b6b7c3 req-1acda625-e9ee-4e56-8899-d99f267ff96a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0626254
May 27 09:34:29.401820 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1dd916a-2b1a-4b37-8efb-eb2ec8d96f8c req-31bae3d4-6653-464c-881c-f7ba1bf31ca5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:29.405246 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f1dd916a-2b1a-4b37-8efb-eb2ec8d96f8c req-31bae3d4-6653-464c-881c-f7ba1bf31ca5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.0920827
May 27 09:34:29.461879 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f1dd916a-2b1a-4b37-8efb-eb2ec8d96f8c req-ac3f8e63-c375-4ff5-b82e-39cabc393baf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0464911
May 27 09:34:31.254439 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-238f012e-23be-4e55-ba9d-862508a9d500 service neutron] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19&fields=id&fields=resource_request HTTP/1.1" status: 200  len: 255 time: 0.1084473
May 27 09:34:31.269377 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd40d14-8011-4a0b-8389-9a5ff3b12b42 req-7320e2b3-719d-4714-b378-d900f1e14ccf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:31.271728 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bfd40d14-8011-4a0b-8389-9a5ff3b12b42 req-7320e2b3-719d-4714-b378-d900f1e14ccf tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.1474199
May 27 09:34:31.349644 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bfd40d14-8011-4a0b-8389-9a5ff3b12b42 req-55e0adce-3c62-4ce4-b121-dba0746103d8 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0658627
May 27 09:34:32.015982 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device bd7e74f7-d502-4ed5-b38d-566afcb0be1a no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:34:32.312174 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-29d1bf72-e344-4f93-b841-1491a3884d5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:32.314909 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-29d1bf72-e344-4f93-b841-1491a3884d5e service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19&tenant_id=f631f0ceb250483891019fb79b2e6b83 HTTP/1.1" status: 200  len: 1096 time: 0.1066849
May 27 09:34:32.440644 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-2b27db0d-e0e8-42eb-9804-b84560173070 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:32.442169 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-2b27db0d-e0e8-42eb-9804-b84560173070 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=f631f0ceb250483891019fb79b2e6b83&device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 1096 time: 0.1005430
May 27 09:34:32.460136 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55882) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:32.693859 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-59bfe44e-3270-4dfc-b112-4a6391351785 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:32.695339 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-59bfe44e-3270-4dfc-b112-4a6391351785 service neutron] 10.222.0.11 "GET /v2.0/networks?id=624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 200  len: 917 time: 0.2458198
May 27 09:34:32.707136 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dec9bcd9-77d1-4172-93c0-80809cd69d7b req-d45f6f31-fda4-41c6-9221-7b1717b315cd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:32.708679 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dec9bcd9-77d1-4172-93c0-80809cd69d7b req-d45f6f31-fda4-41c6-9221-7b1717b315cd tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.1450620
May 27 09:34:32.933736 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dec9bcd9-77d1-4172-93c0-80809cd69d7b req-59dabd0f-9207-4be6-8f1f-9d9cc3a4f75c tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0806518
May 27 09:34:32.935649 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-47119e94-3659-4d00-aeac-7838eacca737 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a HTTP/1.1" status: 200  len: 998 time: 0.2260454
May 27 09:34:33.006291 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-c74452b7-1ee4-4c6a-83a0-6f402dc3fc59 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:33.007790 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-c74452b7-1ee4-4c6a-83a0-6f402dc3fc59 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 200  len: 855 time: 0.0637591
May 27 09:34:33.092779 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-8a2c19d2-b0da-4e22-ae60-dea3b8cf090f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:33.094580 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-8a2c19d2-b0da-4e22-ae60-dea3b8cf090f service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=624aa867-a71e-4343-8899-4e49257cd000&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0731053
May 27 09:34:33.237265 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-3ba40667-3000-4090-8e23-66155d152d87 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1363909
May 27 09:34:33.240937 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3816697'] for router_interface, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:33.386418 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-228ef2eb-56b4-49c2-b089-e0713c8eb59e req-ba60f2e1-b8cf-493f-a8ca-6f70a6a9b514 service neutron] 10.222.0.11 "GET /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1412961
May 27 09:34:33.829097 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Deleting port b018c078-86c3-4e4a-bd90-fa725cdd3369 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:34:33.829594 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:34.021104 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] For port b018c078-86c3-4e4a-bd90-fa725cdd3369, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=b018c078-86c3-4e4a-bd90-fa725cdd3369,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:34.021449 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:34.217994 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Calling delete_port for b018c078-86c3-4e4a-bd90-fa725cdd3369 owned by network:router_interface {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:34:34.281460 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9137518-5b7e-4cc9-9139-afc4487e38d9 req-d171da5c-0431-4f75-9a1f-ea3c882fc263 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:34.282997 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d9137518-5b7e-4cc9-9139-afc4487e38d9 req-d171da5c-0431-4f75-9a1f-ea3c882fc263 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.1249101
May 27 09:34:34.368188 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d9137518-5b7e-4cc9-9139-afc4487e38d9 req-c078e2c6-0233-445a-acbe-e93e560e7f45 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0764844
May 27 09:34:34.587799 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:34.593749 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:34.646311 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Pushing event deleted for resources: {'Port': ['ID=b018c078-86c3-4e4a-bd90-fa725cdd3369,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:34.676358 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:35.006996 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3683824', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3812169'] for router_interface, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:35.602394 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a6bcd3d-a4be-4a8a-bb43-4d9d17ba6217 req-a0d0aa18-ecf4-430a-bb13-12c993268888 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:35.607933 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6a6bcd3d-a4be-4a8a-bb43-4d9d17ba6217 req-a0d0aa18-ecf4-430a-bb13-12c993268888 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.0985250
May 27 09:34:35.641744 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Router ad64253e-1ce7-4c03-90db-1073e41e8e5f has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:34:35.665884 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6a6bcd3d-a4be-4a8a-bb43-4d9d17ba6217 req-401c8ccf-3e64-4b0d-a10a-f02c2e3378fc tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0553286
May 27 09:34:35.833927 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:34:35.845210 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13eced30-9c59-47d7-b1f2-29b3ac5ec631 None None] Sync routers for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:34:35.852014 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] 10.222.0.30 "PUT /v2.0/routers/ad64253e-1ce7-4c03-90db-1073e41e8e5f/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.3897641
May 27 09:34:35.855522 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 55914) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:35.863453 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13eced30-9c59-47d7-b1f2-29b3ac5ec631 None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:34:35.864448 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-13eced30-9c59-47d7-b1f2-29b3ac5ec631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecf55760>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:34:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:36.049340 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Notify callbacks [] for router, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:36.245702 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:36.267415 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-13eced30-9c59-47d7-b1f2-29b3ac5ec631 None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:34:36.411191 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Deleting port 91462db4-2b87-4eb5-a1a1-9d729d8adc42 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:34:36.411747 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:36.619680 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] For port 91462db4-2b87-4eb5-a1a1-9d729d8adc42, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=91462db4-2b87-4eb5-a1a1-9d729d8adc42,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:36.620574 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:36.773123 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-13eced30-9c59-47d7-b1f2-29b3ac5ec631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecf55760>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41'}], 'enable_snat': True}, 'gw_port_id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:34:34Z', 'revision_number': 5, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port': {'id': '91462db4-2b87-4eb5-a1a1-9d729d8adc42', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:85:1b:85', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.41', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:04Z', 'updated_at': '2021-05-27T09:27:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:36.787384 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13eced30-9c59-47d7-b1f2-29b3ac5ec631 None None] Checking router: ad64253e-1ce7-4c03-90db-1073e41e8e5f for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:34:36.798689 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13eced30-9c59-47d7-b1f2-29b3ac5ec631 None None] Routers {'ad64253e-1ce7-4c03-90db-1073e41e8e5f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:34:36.799515 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-13eced30-9c59-47d7-b1f2-29b3ac5ec631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecf55760>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:34:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:36.816113 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Calling delete_port for 91462db4-2b87-4eb5-a1a1-9d729d8adc42 owned by network:router_gateway {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:34:36.995456 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-13eced30-9c59-47d7-b1f2-29b3ac5ec631 None None] Set router ad64253e-1ce7-4c03-90db-1073e41e8e5f gateway port host: None {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:34:37.116496 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-13eced30-9c59-47d7-b1f2-29b3ac5ec631 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecf55760>, [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:34:36Z', 'revision_number': 6, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port_host': None}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:37.122426 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13eced30-9c59-47d7-b1f2-29b3ac5ec631 None None] The sync data for ids ['ad64253e-1ce7-4c03-90db-1073e41e8e5f'] in dv-cinder-772623-6-iscsi is: [{'id': 'ad64253e-1ce7-4c03-90db-1073e41e8e5f', 'name': 'tempest-AttachVolumeTestJSON-1993671404-router', 'tenant_id': '3b2fb81840c64238b0ae0db08ca9b139', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:03Z', 'updated_at': '2021-05-27T09:34:36Z', 'revision_number': 6, 'project_id': '3b2fb81840c64238b0ae0db08ca9b139', 'gw_port_host': None}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:34:37.258724 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-273753a0-7e11-4256-a9a1-4e4e8e24ee7a req-2e7cb15a-e94f-4a99-9c86-1e07435c0e36 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:37.260286 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-273753a0-7e11-4256-a9a1-4e4e8e24ee7a req-2e7cb15a-e94f-4a99-9c86-1e07435c0e36 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.4131885
May 27 09:34:37.352038 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-273753a0-7e11-4256-a9a1-4e4e8e24ee7a req-afe1b1d8-227a-4a46-9045-16113a3970e3 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0837131
May 27 09:34:37.447784 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:37.455915 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-98dee311-9cc7-4796-9ba9-436f0a288c22 tempest-ServerRescueNegativeTestJSON-471548591 tempest-ServerRescueNegativeTestJSON-471548591-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:37.511318 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Pushing event deleted for resources: {'Port': ['ID=91462db4-2b87-4eb5-a1a1-9d729d8adc42,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:37.544742 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:37.648561 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3811286'] for router_gateway, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:37.862697 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3812681', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2009'] for router, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:37.866988 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:37.973412 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3812965'] for router, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:37.974300 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router ad64253e-1ce7-4c03-90db-1073e41e8e5f {{(pid=91821) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 27 09:34:38.000583 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Notify callbacks [] for router, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:38.002031 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] 10.222.0.30 "DELETE /v2.0/routers/ad64253e-1ce7-4c03-90db-1073e41e8e5f HTTP/1.1" status: 204  len: 168 time: 2.1446898
May 27 09:34:38.004925 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 55922) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:38.137663 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_v2 [None req-731b402a-89b4-499f-80bb-7c710e56b074 admin admin] Deleting subnet b2c650ce-3329-4545-aaac-c69109472b2b {{(pid=91821) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:34:38.142536 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-731b402a-89b4-499f-80bb-7c710e56b074 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:38.226957 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-731b402a-89b4-499f-80bb-7c710e56b074 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2232147'] for subnet, precommit_delete_associations {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:38.440172 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device b018c078-86c3-4e4a-bd90-fa725cdd3369 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:34:38.454497 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-731b402a-89b4-499f-80bb-7c710e56b074 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:38.520630 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: b018c078-86c3-4e4a-bd90-fa725cdd3369 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:34:38.521404 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device b018c078-86c3-4e4a-bd90-fa725cdd3369 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:34:38.522075 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 91462db4-2b87-4eb5-a1a1-9d729d8adc42 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:34:38.593886 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 91462db4-2b87-4eb5-a1a1-9d729d8adc42 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:34:38.594234 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 91462db4-2b87-4eb5-a1a1-9d729d8adc42 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:34:38.606900 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-aac7a92f-b3bc-4937-91f3-0e007077d176 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:38.839715 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9dc6119-78be-41c7-8d21-7b2c9e5658c8 req-d6acf487-5785-4438-81b5-9a0c82722cb4 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:38.841696 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f9dc6119-78be-41c7-8d21-7b2c9e5658c8 req-d6acf487-5785-4438-81b5-9a0c82722cb4 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.2106035
May 27 09:34:39.019295 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f9dc6119-78be-41c7-8d21-7b2c9e5658c8 req-353637e6-5525-46d1-8028-b306b55589e5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1700249
May 27 09:34:39.020419 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-731b402a-89b4-499f-80bb-7c710e56b074 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2158057', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2399650'] for subnet, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:39.024890 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:39.062509 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-731b402a-89b4-499f-80bb-7c710e56b074 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b2c650ce-3329-4545-aaac-c69109472b2b,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:39.065617 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-731b402a-89b4-499f-80bb-7c710e56b074 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:39.066622 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-731b402a-89b4-499f-80bb-7c710e56b074 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:39.076398 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-731b402a-89b4-499f-80bb-7c710e56b074 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/b2c650ce-3329-4545-aaac-c69109472b2b HTTP/1.1" status: 204  len: 168 time: 1.0670154
May 27 09:34:39.077127 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0fba713-1bc2-4c34-a371-22343da4f56d None None] Network bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:34:39.077505 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55928) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:39.244037 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:39.324180 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Deleting port 77da385f-1497-48dc-bf55-93ebb14bc441 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:34:39.324432 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:39.427164 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6f4f311-eb5e-4750-b610-747273f1715c None None] DHCP port deletion for bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 request from dv-cinder-772623-6-iscsi {{(pid=91822) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 27 09:34:39.452948 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] For port 77da385f-1497-48dc-bf55-93ebb14bc441, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=77da385f-1497-48dc-bf55-93ebb14bc441,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:39.453537 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:39.545130 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-c6f4f311-eb5e-4750-b610-747273f1715c None None] Deleting port 77da385f-1497-48dc-bf55-93ebb14bc441 {{(pid=91822) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:34:39.545717 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-c6f4f311-eb5e-4750-b610-747273f1715c None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:39.594957 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Calling delete_port for 77da385f-1497-48dc-bf55-93ebb14bc441 owned by network:dhcp {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:34:39.662221 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-c6f4f311-eb5e-4750-b610-747273f1715c None None] For port 77da385f-1497-48dc-bf55-93ebb14bc441, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=77da385f-1497-48dc-bf55-93ebb14bc441,segment=NetworkSegment(3f4b268e-0da0-49f5-8985-9d93ceab74d6),segment_id=3f4b268e-0da0-49f5-8985-9d93ceab74d6)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:39.662640 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-c6f4f311-eb5e-4750-b610-747273f1715c None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:39.665473 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:39.670956 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:39.721624 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Pushing event deleted for resources: {'Port': ['ID=77da385f-1497-48dc-bf55-93ebb14bc441,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:39.728338 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:39.732371 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] No DVR routers for this DVR port 77da385f-1497-48dc-bf55-93ebb14bc441 on host dv-cinder-772623-6-iscsi {{(pid=91820) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:34:39.877978 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-c6f4f311-eb5e-4750-b610-747273f1715c None None] Calling delete_port for 77da385f-1497-48dc-bf55-93ebb14bc441 owned by network:dhcp {{(pid=91822) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:34:39.955923 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:39.976035 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2eed86a190>,) {'filters': {'network_id': ['bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6']}} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:40.008030 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eed86a190>, '3f4b268e-0da0-49f5-8985-9d93ceab74d6') {'for_net_delete': True} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:40.008548 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eed86a190>, '3f4b268e-0da0-49f5-8985-9d93ceab74d6') {} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:34:40.031338 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-c6f4f311-eb5e-4750-b610-747273f1715c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116'] for port, after_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:40.032035 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3483835'] for segment, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:40.035289 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:40.053699 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:40.063234 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Releasing vlan 399 on physical network physnet1 to pool {{(pid=91820) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:34:40.063677 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2421763'] for segment, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]: Traceback (most recent call last):
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     timer()
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     cb(*args, **kw)
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     return func(*args, **kwargs)
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     self._notify()
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     self.callback(batched_events)
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     event.method(event)
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     return f(self, *a, **k)
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._get(url).json()
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self.request(url, 'GET', **kwargs)
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:34:40.078540 dv-cinder-772623-6-iscsi neutron-server[91820]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:34:40.101568 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6f4f311-eb5e-4750-b610-747273f1715c None None] Pushing event deleted for resources: {'Port': ['ID=77da385f-1497-48dc-bf55-93ebb14bc441,revision_number=None']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:40.105074 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-c6f4f311-eb5e-4750-b610-747273f1715c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:40.109623 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6f4f311-eb5e-4750-b610-747273f1715c None None] No DVR routers for this DVR port 77da385f-1497-48dc-bf55-93ebb14bc441 on host dv-cinder-772623-6-iscsi {{(pid=91822) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:34:40.194306 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:40.200396 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:40.203270 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:40.232799 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Pushing event deleted for resources: {'Network': ['ID=bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:40.232799 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:40.258671 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] 10.222.0.30 "DELETE /v2.0/networks/bd3a7c3a-3b17-4985-b6ba-9ac2cd8b97c6 HTTP/1.1" status: 204  len: 168 time: 1.1754880
May 27 09:34:40.341892 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6edf1345-742c-415f-bb39-060094737228 req-6b09e2ee-6589-4822-b3dc-98a3c482c626 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:40.346248 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6edf1345-742c-415f-bb39-060094737228 req-6b09e2ee-6589-4822-b3dc-98a3c482c626 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.1347136
May 27 09:34:40.416354 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 77da385f-1497-48dc-bf55-93ebb14bc441 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:34:40.448028 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6edf1345-742c-415f-bb39-060094737228 req-f24a57e9-a63c-42e0-a50a-03f9185326ca tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0863028
May 27 09:34:40.456248 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 55936) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:40.515268 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 77da385f-1497-48dc-bf55-93ebb14bc441 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:34:40.515673 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 77da385f-1497-48dc-bf55-93ebb14bc441 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:34:40.560513 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-dddc7f52-df3e-4690-a336-72014c137663 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=3b2fb81840c64238b0ae0db08ca9b139&name=default HTTP/1.1" status: 200  len: 2975 time: 0.1023667
May 27 09:34:40.565095 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 55942) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:40.635180 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ee3c76e2-7f27-478a-9964-8b1ffb65925c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:40.669636 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ee3c76e2-7f27-478a-9964-8b1ffb65925c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:40.756997 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ee3c76e2-7f27-478a-9964-8b1ffb65925c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:40.763111 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ee064234-bdaa-4a09-9484-fc3bd85c50f6 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:40.781075 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee3c76e2-7f27-478a-9964-8b1ffb65925c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05e40f2b-819f-4024-b3b0-35e6ffb5bee9,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:40.784269 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ee3c76e2-7f27-478a-9964-8b1ffb65925c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:40.786404 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ee3c76e2-7f27-478a-9964-8b1ffb65925c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:40.787701 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-ee3c76e2-7f27-478a-9964-8b1ffb65925c admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/05e40f2b-819f-4024-b3b0-35e6ffb5bee9 HTTP/1.1" status: 204  len: 168 time: 0.2214770
May 27 09:34:41.454877 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:41.720377 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f42463-5161-4eba-bfe9-0f83fdeace33 req-cdc46d4f-510f-430c-9bb2-62baef625294 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:41.727975 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-02f42463-5161-4eba-bfe9-0f83fdeace33 req-cdc46d4f-510f-430c-9bb2-62baef625294 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.1091526
May 27 09:34:41.780095 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-02f42463-5161-4eba-bfe9-0f83fdeace33 req-ea577293-43ab-4e59-bede-ca6cfcee144b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0500445
May 27 09:34:41.822698 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-89205f4b-27f7-4f9a-94f9-95f55a71188d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:42.380821 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:43.031771 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4db89921-b29a-47a3-842f-3d024ec5dfbf req-d0ada581-feaf-493e-a89c-ad70409759a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:43.033537 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4db89921-b29a-47a3-842f-3d024ec5dfbf req-d0ada581-feaf-493e-a89c-ad70409759a1 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.1199815
May 27 09:34:43.086437 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4db89921-b29a-47a3-842f-3d024ec5dfbf req-70a35f63-f0c4-40c2-b44d-671568325eb4 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0467610
May 27 09:34:44.344144 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-101919c2-93f8-4938-b9d8-bf1954d4d93b req-46a9dd4e-7872-4c30-b017-438363dfb071 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:44.352380 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-101919c2-93f8-4938-b9d8-bf1954d4d93b req-46a9dd4e-7872-4c30-b017-438363dfb071 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.1166728
May 27 09:34:44.407120 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-101919c2-93f8-4938-b9d8-bf1954d4d93b req-22d3ed6f-736b-4e32-84d3-62b9aeafbb4e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0534840
May 27 09:34:44.927836 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:45.611854 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcbe46bd-9c73-45b7-a646-188f375f059e req-7fe953e8-ff63-4e60-92b1-4cce99f37ac5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:45.613323 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dcbe46bd-9c73-45b7-a646-188f375f059e req-7fe953e8-ff63-4e60-92b1-4cce99f37ac5 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.0930169
May 27 09:34:45.669933 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dcbe46bd-9c73-45b7-a646-188f375f059e req-21dae31f-6b41-4e04-9536-72be233985da tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0492704
May 27 09:34:46.865715 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ac82be-c7e6-4d63-98c3-ae0ab0450aff req-be0aebc8-7b14-4d84-b2f6-6de4361dce64 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:46.867210 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69ac82be-c7e6-4d63-98c3-ae0ab0450aff req-be0aebc8-7b14-4d84-b2f6-6de4361dce64 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.0826013
May 27 09:34:46.913278 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69ac82be-c7e6-4d63-98c3-ae0ab0450aff req-db33b206-50ca-46a3-9249-96b38604366b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0398030
May 27 09:34:48.073700 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device bd7e74f7-d502-4ed5-b38d-566afcb0be1a details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:34:48.112797 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4ce96e0-d13a-4415-aea0-6ed44f147feb req-4fea2275-9d07-441d-9a78-728faee43153 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:48.114341 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c4ce96e0-d13a-4415-aea0-6ed44f147feb req-4fea2275-9d07-441d-9a78-728faee43153 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 943 time: 0.0891981
May 27 09:34:48.161780 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c4ce96e0-d13a-4415-aea0-6ed44f147feb req-29ef0624-1391-4ce8-8a38-e5780c99e6be tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0402374
May 27 09:34:48.240592 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:48.255913 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'port_id': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'mac_address': 'fa:16:3e:45:6e:69', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 396, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:34:48.313935 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:48.332370 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bd7e74f7-d502-4ed5-b38d-566afcb0be1a {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:34:48.348584 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:48.353056 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:48.354823 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:48.425519 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,revision_number=9']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:48.432822 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.433170 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.433546 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.433918 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.434266 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.434593 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.434970 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.435230 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.435596 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.435919 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.436245 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.436563 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:48.440925 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:48.581596 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['bd7e74f7-d502-4ed5-b38d-566afcb0be1a'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:34:49.360116 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5684713c-ad79-4558-ac6b-19bd92d26128 req-af283cad-b5a3-4543-a462-bba514623043 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:49.361836 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5684713c-ad79-4558-ac6b-19bd92d26128 req-af283cad-b5a3-4543-a462-bba514623043 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 944 time: 0.0840948
May 27 09:34:49.410141 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5684713c-ad79-4558-ac6b-19bd92d26128 req-25b05f46-6769-445d-9386-60066fe4ae33 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0419185
May 27 09:34:50.104943 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device bd7e74f7-d502-4ed5-b38d-566afcb0be1a up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:34:50.177937 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port bd7e74f7-d502-4ed5-b38d-566afcb0be1a triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:34:50.178383 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:50.318030 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:50.350935 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:34:50.363000 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:34:50.370135 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:50.373515 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-77265e01-580c-41db-8096-8a660d058be7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:50.434247 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'code': 200}
May 27 09:34:50.491195 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,revision_number=10']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:50.496565 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:50.709134 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e26f256-0513-4c65-96d7-417a7565a0bc req-68ab8be7-bd3c-425b-8320-06a6ed82f560 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:50.710697 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4e26f256-0513-4c65-96d7-417a7565a0bc req-68ab8be7-bd3c-425b-8320-06a6ed82f560 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 1099 time: 0.1101875
May 27 09:34:50.719071 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea531894-f82f-4320-ba34-1d91a26c815c req-41e8709f-8eaf-4603-8540-85e6b4099894 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:50.723631 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ea531894-f82f-4320-ba34-1d91a26c815c req-41e8709f-8eaf-4603-8540-85e6b4099894 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 946 time: 0.1745057
May 27 09:34:50.831098 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ea531894-f82f-4320-ba34-1d91a26c815c req-3f6a1a81-3f43-4351-9b06-f01f25ebce0e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1028054
May 27 09:34:50.835039 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4e26f256-0513-4c65-96d7-417a7565a0bc req-e710a324-5ecc-4dec-89a1-b81731a3e238 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1095114
May 27 09:34:52.090497 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf98b43a-d41b-45b5-a498-55f3a40c32a3 req-397b7c0d-ab72-49a0-aacb-433ce2676c3d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:52.092175 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cf98b43a-d41b-45b5-a498-55f3a40c32a3 req-397b7c0d-ab72-49a0-aacb-433ce2676c3d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 946 time: 0.0918131
May 27 09:34:52.166645 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cf98b43a-d41b-45b5-a498-55f3a40c32a3 req-3ca3f9a2-0cd5-4e11-9da0-d9b5f846c058 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0676270
May 27 09:34:52.360133 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56118) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:52.495423 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f2fac06e-f874-47c7-a555-33f41ff6058d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:52.517705 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-f2fac06e-f874-47c7-a555-33f41ff6058d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:34:52.522279 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-f2fac06e-f874-47c7-a555-33f41ff6058d admin admin] Usage tracker for resource:security_group_rule and tenant:aa607ff5e4734e778a0242b005b5de1b is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:34:52.525697 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-f2fac06e-f874-47c7-a555-33f41ff6058d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:34:52.533876 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-f2fac06e-f874-47c7-a555-33f41ff6058d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:34:52.645523 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f2fac06e-f874-47c7-a555-33f41ff6058d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:52.654026 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f2fac06e-f874-47c7-a555-33f41ff6058d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:52.664550 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-900081d0-a600-437c-9818-1c577d2e920d tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:52.709638 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-f2fac06e-f874-47c7-a555-33f41ff6058d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=aa607ff5e4734e778a0242b005b5de1b&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3480003
May 27 09:34:52.711322 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2fac06e-f874-47c7-a555-33f41ff6058d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1864eb3e-c0c6-4b6b-9dbd-38d35d6278fd,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:52.712505 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56124) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:34:52.715116 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-f2fac06e-f874-47c7-a555-33f41ff6058d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:52.781803 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:52.811468 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:52.873372 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:52.877669 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2fab837b-7021-4dbe-bafd-7ef395f54a3a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:34:52.891463 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1864eb3e-c0c6-4b6b-9dbd-38d35d6278fd,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:34:52.902910 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:52.904183 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/1864eb3e-c0c6-4b6b-9dbd-38d35d6278fd HTTP/1.1" status: 204  len: 168 time: 0.1905899
May 27 09:34:52.905635 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.906020 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.906394 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.906775 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.907177 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.907574 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.908117 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.910815 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.910815 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.910815 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.910815 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.910815 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:34:52.913202 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:34:53.399008 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c86b1e1e-9cb7-450a-9c45-534465d222c9 req-ae1ed1f2-e12d-428f-9b5e-6771123cd4fa tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:34:53.400942 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c86b1e1e-9cb7-450a-9c45-534465d222c9 req-ae1ed1f2-e12d-428f-9b5e-6771123cd4fa tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 946 time: 0.0921264
May 27 09:34:53.484062 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c86b1e1e-9cb7-450a-9c45-534465d222c9 req-22a9cd2b-3960-4b17-981a-0aad0d5c4f18 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.0752656
May 27 09:34:56.425605 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:34:57.103254 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:35:01.158466 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56250) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:01.308434 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e26c3c9d-eacd-4126-97ff-ad8ca2b4f6b6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:01.439903 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e26c3c9d-eacd-4126-97ff-ad8ca2b4f6b6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:01.444128 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e26c3c9d-eacd-4126-97ff-ad8ca2b4f6b6 admin admin] Usage tracker for resource:security_group_rule and tenant:93c34e13a1fd4e81b084dd28227d7e9a is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:01.447140 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e26c3c9d-eacd-4126-97ff-ad8ca2b4f6b6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:01.454278 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e26c3c9d-eacd-4126-97ff-ad8ca2b4f6b6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:01.548496 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e26c3c9d-eacd-4126-97ff-ad8ca2b4f6b6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:01.553246 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e26c3c9d-eacd-4126-97ff-ad8ca2b4f6b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:01.562684 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4c79fb36-079e-4d56-bd2d-4bd4ce97cf31 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:01.609079 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-e26c3c9d-eacd-4126-97ff-ad8ca2b4f6b6 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=93c34e13a1fd4e81b084dd28227d7e9a&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4494867
May 27 09:35:01.610205 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e26c3c9d-eacd-4126-97ff-ad8ca2b4f6b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44540d75-e82c-414d-a509-130e3010abd9,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:01.612234 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56256) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:01.614597 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e26c3c9d-eacd-4126-97ff-ad8ca2b4f6b6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:01.684638 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-674d7faf-44ea-4184-9613-80fe8ae57530 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:01.715089 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-674d7faf-44ea-4184-9613-80fe8ae57530 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:01.778680 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-674d7faf-44ea-4184-9613-80fe8ae57530 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:01.782550 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7f0d403b-1ce2-4778-a651-728d4b1bd82d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:01.798141 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-674d7faf-44ea-4184-9613-80fe8ae57530 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44540d75-e82c-414d-a509-130e3010abd9,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:01.802648 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-674d7faf-44ea-4184-9613-80fe8ae57530 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:01.809634 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-674d7faf-44ea-4184-9613-80fe8ae57530 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:01.810883 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-674d7faf-44ea-4184-9613-80fe8ae57530 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/44540d75-e82c-414d-a509-130e3010abd9 HTTP/1.1" status: 204  len: 168 time: 0.1973147
May 27 09:35:02.234839 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56264) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:02.254529 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-485798c4-808c-41f9-a272-153f1194385d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:02.270567 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-485798c4-808c-41f9-a272-153f1194385d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:02.274626 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-485798c4-808c-41f9-a272-153f1194385d admin admin] Usage tracker for resource:security_group_rule and tenant:2d11ab856fb34563bc685509639936cd is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:02.278587 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-485798c4-808c-41f9-a272-153f1194385d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:02.285592 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-485798c4-808c-41f9-a272-153f1194385d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:02.398409 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-485798c4-808c-41f9-a272-153f1194385d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:02.404290 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-485798c4-808c-41f9-a272-153f1194385d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:02.415482 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ee3c76e2-7f27-478a-9964-8b1ffb65925c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:02.478790 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-485798c4-808c-41f9-a272-153f1194385d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=2d11ab856fb34563bc685509639936cd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2424817
May 27 09:35:02.481265 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-485798c4-808c-41f9-a272-153f1194385d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd586d56-685d-420e-80b0-866cff83b4fe,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:02.482963 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56268) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:02.484830 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-485798c4-808c-41f9-a272-153f1194385d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:02.565965 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b23fcfb9-545a-47f2-b497-1795c39f5531 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:02.595143 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b23fcfb9-545a-47f2-b497-1795c39f5531 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:02.665566 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b23fcfb9-545a-47f2-b497-1795c39f5531 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:02.671353 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:02.688959 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b23fcfb9-545a-47f2-b497-1795c39f5531 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd586d56-685d-420e-80b0-866cff83b4fe,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:02.692167 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b23fcfb9-545a-47f2-b497-1795c39f5531 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:02.702013 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b23fcfb9-545a-47f2-b497-1795c39f5531 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:02.703165 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-b23fcfb9-545a-47f2-b497-1795c39f5531 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/cd586d56-685d-420e-80b0-866cff83b4fe HTTP/1.1" status: 204  len: 168 time: 0.2185516
May 27 09:35:04.187126 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56300) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:04.346160 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-9c9a410c-941a-4fd6-a823-c4997b4c198f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:04.364675 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-9c9a410c-941a-4fd6-a823-c4997b4c198f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:04.369768 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-9c9a410c-941a-4fd6-a823-c4997b4c198f admin admin] Usage tracker for resource:security_group_rule and tenant:0820b4220618487493145f133e65dbdf is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:04.374428 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-9c9a410c-941a-4fd6-a823-c4997b4c198f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:04.382474 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-9c9a410c-941a-4fd6-a823-c4997b4c198f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:04.513916 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-9c9a410c-941a-4fd6-a823-c4997b4c198f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:04.520299 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-9c9a410c-941a-4fd6-a823-c4997b4c198f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:04.537300 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b23fcfb9-545a-47f2-b497-1795c39f5531 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:04.594926 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-9c9a410c-941a-4fd6-a823-c4997b4c198f admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=0820b4220618487493145f133e65dbdf&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4061460
May 27 09:35:04.597529 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c9a410c-941a-4fd6-a823-c4997b4c198f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70096e16-8984-4e43-a5d7-11bd7c902cf5,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:04.599123 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56306) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:04.601874 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-9c9a410c-941a-4fd6-a823-c4997b4c198f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:04.683713 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6d7c406a-b4a6-4301-9d6b-08b8bb3f52d6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:04.717066 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6d7c406a-b4a6-4301-9d6b-08b8bb3f52d6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:04.787853 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6d7c406a-b4a6-4301-9d6b-08b8bb3f52d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:04.795654 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0dcbd82e-e6df-4e4e-b115-fcfd4f48d13f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:04.811819 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d7c406a-b4a6-4301-9d6b-08b8bb3f52d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70096e16-8984-4e43-a5d7-11bd7c902cf5,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:04.816172 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-6d7c406a-b4a6-4301-9d6b-08b8bb3f52d6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:04.826554 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-6d7c406a-b4a6-4301-9d6b-08b8bb3f52d6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:04.830507 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-6d7c406a-b4a6-4301-9d6b-08b8bb3f52d6 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/70096e16-8984-4e43-a5d7-11bd7c902cf5 HTTP/1.1" status: 204  len: 168 time: 0.2261088
May 27 09:35:05.686968 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56330) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:05.834036 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1204200645-network', 'tenant_id': 'df5fdd9e30044571812bfe2cc2233af6'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:35:05.842935 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:05.851259 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Usage tracker for resource:network and tenant:df5fdd9e30044571812bfe2cc2233af6 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:05.863124 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:05.873711 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:05.889105 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Made reservation on behalf of df5fdd9e30044571812bfe2cc2233af6 for: {'network': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:35:05.892759 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:05.908732 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:05.925639 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:05.930234 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Usage tracker for resource:security_group_rule and tenant:df5fdd9e30044571812bfe2cc2233af6 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:05.933325 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:05.939701 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:06.056412 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:06.061396 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:06.064751 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a4a91f7d-da49-4710-aa4c-16fdbcf69535 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:06.097555 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] vlan segment allocate from pool success with {'vlan_id': 384, 'physical_network': 'physnet1'}  {{(pid=91821) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:35:06.107010 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4f24706-1975-4704-b0ee-0a487db61b43,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:06.111040 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:06.116229 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:06.116229 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.segments_db [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Added segment 94a48d31-baf7-45c2-bce8-12ad5cc3d6a7 of type vlan for network 435a0e3f-efcc-4b4f-9d00-e12d96978c86
May 27 09:35:06.148347 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:06.184001 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:06.185571 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:06.186334 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:06.190228 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-3a3eea60-4a1e-4702-a640-ae1af48b9d93 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:06.413467 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 882 time: 0.7250504
May 27 09:35:06.414833 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Pushing event updated for resources: {'Network': ['ID=435a0e3f-efcc-4b4f-9d00-e12d96978c86,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:06.418821 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56336) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:06.426935 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Request body: {'subnet': {'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1204200645-subnet', 'tenant_id': 'df5fdd9e30044571812bfe2cc2233af6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:35:06.431693 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:35:06.432556 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-2a5f7ece-cf3a-42b4-b4ad-e8fc10527927 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:06.435744 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:06.441490 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Usage tracker for resource:subnet and tenant:df5fdd9e30044571812bfe2cc2233af6 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:06.446103 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:06.453813 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:06.470329 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Made reservation on behalf of df5fdd9e30044571812bfe2cc2233af6 for: {'subnet': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:35:06.473580 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2399631'] for subnet, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:06.961209 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2157992', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2399641'] for subnet, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:06.966735 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-64965aab-2399-4118-a433-c1e6821abb90 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:07.042006 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Pushing event updated for resources: {'Subnet': ['ID=11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:07.045813 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:07.058570 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Checking segment: {'id': '94a48d31-baf7-45c2-bce8-12ad5cc3d6a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:35:07.058570 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Network hostable DHCP agents. Network: 435a0e3f-efcc-4b4f-9d00-e12d96978c86, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91821) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:35:07.079696 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91821) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:35:07.091912 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 435a0e3f-efcc-4b4f-9d00-e12d96978c86) {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:35:07.107324 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:07.107740 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0acb40b9-24a3-4c13-a8ea-e9d6dc204037 None None] Network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:35:07.108366 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:07.144282 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-4baa1b80-820d-46a3-9279-4f9d3d9dd5ae admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 846 time: 0.7239535
May 27 09:35:07.332959 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8adc1b3e-7971-4783-9406-519f26e8bc53 None None] Network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:35:08.501688 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1eaa88d9-6dac-4241-b89d-7eb5f0ff4fb5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:09.514625 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-ec2ae945-849f-4959-932f-879d2ed3581a tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:09.515417 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-ec2ae945-849f-4959-932f-879d2ed3581a tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Synchronizing usage tracker for tenant:df5fdd9e30044571812bfe2cc2233af6 on resource:network {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:35:09.536967 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-ec2ae945-849f-4959-932f-879d2ed3581a tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Unset dirty status for tenant:df5fdd9e30044571812bfe2cc2233af6 on resource:network {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:35:09.538596 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-ec2ae945-849f-4959-932f-879d2ed3581a tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/networks?id=435a0e3f-efcc-4b4f-9d00-e12d96978c86 HTTP/1.1" status: 200  len: 809 time: 0.2197824
May 27 09:35:09.557017 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-1df96ae1-cf66-49d0-b507-54bb09e85c71 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/quotas/df5fdd9e30044571812bfe2cc2233af6 HTTP/1.1" status: 200  len: 375 time: 0.0109930
May 27 09:35:09.613838 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-09e6cbc7-ccb8-47a8-ae9a-7766d7bf32af tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=df5fdd9e30044571812bfe2cc2233af6&fields=id HTTP/1.1" status: 200  len: 210 time: 0.0492070
May 27 09:35:09.779225 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-12e9916e-6d2f-4153-bb0e-76e819f43eea service neutron] 10.222.0.30 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1565983
May 27 09:35:09.936477 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-c50b7ee5-48ef-4c69-b100-b0f4e8f62ece service neutron] 10.222.0.30 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1507242
May 27 09:35:10.175052 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7051668c-010e-4717-bc9b-d35483ef42c1 req-394f9945-0f58-4d14-8c36-4081da1eef41 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 210 time: 0.0721898
May 27 09:35:10.847279 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56374) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:11.314335 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Deleting port 95111807-faa4-4f90-b428-5e65ff824272 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:11.314682 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:11.431808 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-419db5d1-2963-4726-bb7a-b15309b5c8d5 req-8c466e89-8273-4e1e-80d8-3dacfd295792 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 210 time: 0.0789161
May 27 09:35:11.481278 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:11.523408 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:11.523820 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:11.540390 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-0f595ada-8d15-411a-8b8d-7a5e84671e1d tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:11.543427 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-0f595ada-8d15-411a-8b8d-7a5e84671e1d tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.11 "GET /v2.0/networks?id=435a0e3f-efcc-4b4f-9d00-e12d96978c86 HTTP/1.1" status: 200  len: 809 time: 0.3214839
May 27 09:35:11.558630 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Request body: {'port': {'device_id': 'ddaa8be2-8193-4629-b53a-ddb9a5b75804', 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86', 'admin_state_up': True, 'tenant_id': 'df5fdd9e30044571812bfe2cc2233af6'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:35:11.719992 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Calling delete_port for 95111807-faa4-4f90-b428-5e65ff824272 owned by network:floatingip {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:11.786142 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:11.792194 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Usage tracker for resource:port and tenant:df5fdd9e30044571812bfe2cc2233af6 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:11.797226 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:11.811119 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:11.833994 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-71227e14-704b-4fe8-817b-0dece03a8360 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:11.837055 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Made reservation on behalf of df5fdd9e30044571812bfe2cc2233af6 for: {'port': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:35:11.847145 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:11.925851 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:11.929560 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ca64904a-9414-430a-ae91-164d560fc6fd tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:11.983151 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event deleted for resources: {'Port': ['ID=95111807-faa4-4f90-b428-5e65ff824272,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:11.986472 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:12.098592 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for floatingip, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:12.098855 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.l3_db [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Floating IP 3e2b6984-3c92-4d2b-80e1-90ed0b815aa3 disassociated (deleted). External IP: 172.27.1.54, port: 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d.
May 27 09:35:12.140712 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Allocated IP 172.20.0.10 (435a0e3f-efcc-4b4f-9d00-e12d96978c86/11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f/9b310712-03d4-467f-a783-496f07c3b8fa) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:35:12.387015 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:12.529722 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:12.531353 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Router 9a650133-6433-44b6-9741-b3bd050216ae has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:35:12.623824 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:12.630586 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ceb42649-5607-431a-989a-4638f5c415c7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:12.669509 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-13e2e2f2-d0a8-4771-9fbe-f947dbc08109 req-0ac66e36-ff2f-4005-a8f2-4357f04268e8 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 210 time: 0.0955374
May 27 09:35:12.711990 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:35:12.716588 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:35:12.720391 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:35:12.773437 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Pushing event updated for resources: {'Port': ['ID=9b310712-03d4-467f-a783-496f07c3b8fa,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:12.776790 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:12.801694 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:12.802503 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:12.825909 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.2739136
May 27 09:35:12.843073 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Request body: {'port': {'device_id': 'ddaa8be2-8193-4629-b53a-ddb9a5b75804', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:35:12.860102 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:35:12.871880 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56e4a749-8b5f-4469-9671-c72234e65b5c None None] Sync routers for ids ['9a650133-6433-44b6-9741-b3bd050216ae'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:35:12.889801 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56e4a749-8b5f-4469-9671-c72234e65b5c None None] Routers {'9a650133-6433-44b6-9741-b3bd050216ae'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:35:12.890825 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-56e4a749-8b5f-4469-9671-c72234e65b5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd192e0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['9a650133-6433-44b6-9741-b3bd050216ae'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:12.899099 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:12.978148 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "DELETE /v2.0/floatingips/3e2b6984-3c92-4d2b-80e1-90ed0b815aa3 HTTP/1.1" status: 204  len: 168 time: 2.1292226
May 27 09:35:12.979777 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:35:12.994497 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:13.037591 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'status': 'completed', 'code': 200}
May 27 09:35:13.151122 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a25a0a7-c07e-46a1-b5db-b313fc72da01 req-0d617aa2-a463-4829-bd5c-618f290dbb86 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:13.153327 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5a25a0a7-c07e-46a1-b5db-b313fc72da01 req-0d617aa2-a463-4829-bd5c-618f290dbb86 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=a31154df1ce4420f9bdf53b8b3b3649e&device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 1098 time: 0.0845392
May 27 09:35:13.298329 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-56e4a749-8b5f-4469-9671-c72234e65b5c None None] Set router 9a650133-6433-44b6-9741-b3bd050216ae gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:35:13.319131 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a25a0a7-c07e-46a1-b5db-b313fc72da01 req-10102beb-cee1-4af0-966b-0d66492ee733 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:13.321064 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5a25a0a7-c07e-46a1-b5db-b313fc72da01 req-10102beb-cee1-4af0-966b-0d66492ee733 service neutron] 10.222.0.11 "GET /v2.0/networks?id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba HTTP/1.1" status: 200  len: 909 time: 0.1606824
May 27 09:35:13.405468 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5a25a0a7-c07e-46a1-b5db-b313fc72da01 req-63ba309a-5aad-4b0f-a112-8eaaf0e9fb81 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d HTTP/1.1" status: 200  len: 217 time: 0.0763910
May 27 09:35:13.501867 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a25a0a7-c07e-46a1-b5db-b313fc72da01 req-8def531d-95e2-4c3d-9405-451b1f48263a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:13.503386 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5a25a0a7-c07e-46a1-b5db-b313fc72da01 req-8def531d-95e2-4c3d-9405-451b1f48263a service neutron] 10.222.0.11 "GET /v2.0/subnets?id=6659533b-b3b0-4d3c-8bf0-709a19b7728d HTTP/1.1" status: 200  len: 847 time: 0.0903418
May 27 09:35:13.570105 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9b310712-03d4-467f-a783-496f07c3b8fa {{(pid=91821) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:35:13.583887 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:13.604377 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Transition to ACTIVE for port object 9b310712-03d4-467f-a783-496f07c3b8fa will not be triggered until provisioned by entity L2. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:35:13.612496 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:13.622480 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0660ff29-a2f9-4f09-9cc4-510985e10d50 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:13.639407 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a25a0a7-c07e-46a1-b5db-b313fc72da01 req-25281b3d-d058-44a8-917c-877e6c95c315 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:13.641207 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5a25a0a7-c07e-46a1-b5db-b313fc72da01 req-25281b3d-d058-44a8-917c-877e6c95c315 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=1f49b134-af0c-46a8-b862-f6cb6b6a0bba&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1299512
May 27 09:35:13.785675 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Pushing event updated for resources: {'Port': ['ID=9b310712-03d4-467f-a783-496f07c3b8fa,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:13.789470 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:13.839673 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-56e4a749-8b5f-4469-9671-c72234e65b5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd192e0>, [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:08Z', 'revision_number': 4, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c03df627-c904-49cf-8192-55ef32975e9a', 'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'mac_address': 'fa:16:3e:ca:67:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:07Z', 'updated_at': '2021-05-27T09:29:17Z', 'revision_number': 5, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'subnets': [{'id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:13.847064 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56e4a749-8b5f-4469-9671-c72234e65b5c None None] Checking router: 9a650133-6433-44b6-9741-b3bd050216ae for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:35:13.851981 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5a25a0a7-c07e-46a1-b5db-b313fc72da01 req-a57710d6-95cf-4f7b-a89b-c90e2b5b8e5c service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2007165
May 27 09:35:13.862780 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56e4a749-8b5f-4469-9671-c72234e65b5c None None] Routers {'9a650133-6433-44b6-9741-b3bd050216ae'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:35:13.863665 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-56e4a749-8b5f-4469-9671-c72234e65b5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd192e0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['9a650133-6433-44b6-9741-b3bd050216ae'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:14.007263 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5a25a0a7-c07e-46a1-b5db-b313fc72da01 req-034b1e98-c4b5-4d6c-bd3f-4100d9862e02 service neutron] 10.222.0.11 "GET /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1477876
May 27 09:35:14.026112 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92867914-361e-43df-b8a2-302585bc352e req-d479f4f2-ecab-4d59-b87d-185d8d19f619 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:14.028635 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-92867914-361e-43df-b8a2-302585bc352e req-d479f4f2-ecab-4d59-b87d-185d8d19f619 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.3114841
May 27 09:35:14.037444 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Attempting to bind port 9b310712-03d4-467f-a783-496f07c3b8fa on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:35:14.037802 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Attempting to bind port 9b310712-03d4-467f-a783-496f07c3b8fa by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '94a48d31-baf7-45c2-bce8-12ad5cc3d6a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86'}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:35:14.038108 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Attempting to bind port 9b310712-03d4-467f-a783-496f07c3b8fa on network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:35:14.064795 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Port 9b310712-03d4-467f-a783-496f07c3b8fa on network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:35:14.065157 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Attempting to bind port 9b310712-03d4-467f-a783-496f07c3b8fa on network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:35:14.076076 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 34, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:35:14.076398 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Checking segment: {'id': '94a48d31-baf7-45c2-bce8-12ad5cc3d6a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:35:14.076803 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Bound using segment: {'id': '94a48d31-baf7-45c2-bce8-12ad5cc3d6a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86'} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:35:14.077255 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Bound port: 9b310712-03d4-467f-a783-496f07c3b8fa, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '94a48d31-baf7-45c2-bce8-12ad5cc3d6a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86'}}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:35:14.077603 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:14.097048 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e84afac3-e5a7-4536-8df4-41e4a4ed0936 req-a115e832-5e8b-461f-9f68-4e720303e886 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:14.097770 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-e84afac3-e5a7-4536-8df4-41e4a4ed0936 req-a115e832-5e8b-461f-9f68-4e720303e886 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Synchronizing usage tracker for tenant:df5fdd9e30044571812bfe2cc2233af6 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:35:14.126822 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-56e4a749-8b5f-4469-9671-c72234e65b5c None None] Set router 9a650133-6433-44b6-9741-b3bd050216ae gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:35:14.162270 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-92867914-361e-43df-b8a2-302585bc352e req-78b9bd18-21b6-4251-aba5-b83db68218a1 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1269376
May 27 09:35:14.176934 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-e84afac3-e5a7-4536-8df4-41e4a4ed0936 req-a115e832-5e8b-461f-9f68-4e720303e886 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Unset dirty status for tenant:df5fdd9e30044571812bfe2cc2233af6 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:35:14.178097 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e84afac3-e5a7-4536-8df4-41e4a4ed0936 req-a115e832-5e8b-461f-9f68-4e720303e886 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 944 time: 0.3356452
May 27 09:35:14.255011 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-e84afac3-e5a7-4536-8df4-41e4a4ed0936 req-96d9ae85-c30e-4fcc-9e3f-feb5b08a1814 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Synchronizing usage tracker for tenant:df5fdd9e30044571812bfe2cc2233af6 on resource:security_group {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:35:14.260201 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] For port 9b310712-03d4-467f-a783-496f07c3b8fa, host hv-cinder-77262, cleared binding levels {{(pid=91821) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:35:14.264279 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] For port 9b310712-03d4-467f-a783-496f07c3b8fa, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9b310712-03d4-467f-a783-496f07c3b8fa,segment=NetworkSegment(94a48d31-baf7-45c2-bce8-12ad5cc3d6a7),segment_id=94a48d31-baf7-45c2-bce8-12ad5cc3d6a7)] {{(pid=91821) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:35:14.271051 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:14.277806 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dba96c23-23f5-4b63-b6f2-0c9bad45d922 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:14.329329 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-e84afac3-e5a7-4536-8df4-41e4a4ed0936 req-96d9ae85-c30e-4fcc-9e3f-feb5b08a1814 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Unset dirty status for tenant:df5fdd9e30044571812bfe2cc2233af6 on resource:security_group {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:35:14.331024 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e84afac3-e5a7-4536-8df4-41e4a4ed0936 req-96d9ae85-c30e-4fcc-9e3f-feb5b08a1814 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1443291
May 27 09:35:14.348719 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:14.349336 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:14.350702 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] 10.222.0.11 "PUT /v2.0/ports/9b310712-03d4-467f-a783-496f07c3b8fa HTTP/1.1" status: 200  len: 1094 time: 1.5172336
May 27 09:35:14.351206 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ddaa8be2-8193-4629-b53a-ddb9a5b75804', 'tag': '9b310712-03d4-467f-a783-496f07c3b8fa'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:35:14.378434 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Pushing event updated for resources: {'Port': ['ID=9b310712-03d4-467f-a783-496f07c3b8fa,revision_number=3']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:14.382562 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:14.447196 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ddaa8be2-8193-4629-b53a-ddb9a5b75804', 'tag': '9b310712-03d4-467f-a783-496f07c3b8fa', 'status': 'completed', 'code': 200}
May 27 09:35:14.486134 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-d20273a4-1b87-4684-8c48-bdb6939259ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:14.487759 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-d20273a4-1b87-4684-8c48-bdb6939259ec service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=df5fdd9e30044571812bfe2cc2233af6&device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 1097 time: 0.0807748
May 27 09:35:14.489632 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-56e4a749-8b5f-4469-9671-c72234e65b5c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd192e0>, [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:08Z', 'revision_number': 4, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c03df627-c904-49cf-8192-55ef32975e9a', 'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'mac_address': 'fa:16:3e:ca:67:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:07Z', 'updated_at': '2021-05-27T09:29:17Z', 'revision_number': 5, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'subnets': [{'id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:14.493634 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56e4a749-8b5f-4469-9671-c72234e65b5c None None] The sync data for ids ['9a650133-6433-44b6-9741-b3bd050216ae'] in dv-cinder-772623-6-iscsi is: [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:29:08Z', 'revision_number': 4, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c03df627-c904-49cf-8192-55ef32975e9a', 'name': '', 'network_id': '1f49b134-af0c-46a8-b862-f6cb6b6a0bba', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'mac_address': 'fa:16:3e:ca:67:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:07Z', 'updated_at': '2021-05-27T09:29:17Z', 'revision_number': 5, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'subnets': [{'id': '6659533b-b3b0-4d3c-8bf0-709a19b7728d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:35:14.667361 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-ae1dc010-7eca-4ab1-ac27-6391644709f3 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9b310712-03d4-467f-a783-496f07c3b8fa HTTP/1.1" status: 200  len: 217 time: 0.1705558
May 27 09:35:14.721685 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-06425fa9-c8cb-4f45-b7db-caaa4856a718 None None] New status for floating IP 3e2b6984-3c92-4d2b-80e1-90ed0b815aa3: DOWN {{(pid=91822) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:35:14.734181 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-6122140b-0adf-48ac-afc1-fc44fc08e10b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:14.735651 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-6122140b-0adf-48ac-afc1-fc44fc08e10b service neutron] 10.222.0.11 "GET /v2.0/subnets?id=11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f HTTP/1.1" status: 200  len: 849 time: 0.0612216
May 27 09:35:14.796489 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-0092de43-5a5a-4fc5-8a3d-e08053ef78b7 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=435a0e3f-efcc-4b4f-9d00-e12d96978c86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0538058
May 27 09:35:14.928876 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:14.947526 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-4bba0938-515b-4880-951f-c580e2bef6de service neutron] 10.222.0.11 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1433363
May 27 09:35:15.113279 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9998dea2-71d4-4dea-b473-0f04cc29e7da req-1d02b4a6-0444-473a-bd10-cce29af58275 service neutron] 10.222.0.11 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1443486
May 27 09:35:15.193674 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ace8dd09-590f-400d-8905-5042323b8f9c req-8dfa4608-127b-4421-a55b-99b1e5aba5c2 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:15.195100 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-ace8dd09-590f-400d-8905-5042323b8f9c req-8dfa4608-127b-4421-a55b-99b1e5aba5c2 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Synchronizing usage tracker for tenant:a31154df1ce4420f9bdf53b8b3b3649e on resource:port {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:35:15.213269 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-ace8dd09-590f-400d-8905-5042323b8f9c req-8dfa4608-127b-4421-a55b-99b1e5aba5c2 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Unset dirty status for tenant:a31154df1ce4420f9bdf53b8b3b3649e on resource:port {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:35:15.215187 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ace8dd09-590f-400d-8905-5042323b8f9c req-8dfa4608-127b-4421-a55b-99b1e5aba5c2 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.11 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.1005487
May 27 09:35:15.236759 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca892f2e-6018-4ce4-8665-965f6f0040e7 req-b8d82963-406d-4b83-9402-9c5f2549c4aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:15.238277 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ca892f2e-6018-4ce4-8665-965f6f0040e7 req-b8d82963-406d-4b83-9402-9c5f2549c4aa service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=df5fdd9e30044571812bfe2cc2233af6&device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 1097 time: 0.0797677
May 27 09:35:15.366008 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-ace8dd09-590f-400d-8905-5042323b8f9c req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Deleting port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:15.366356 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-ace8dd09-590f-400d-8905-5042323b8f9c req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:15.428649 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca892f2e-6018-4ce4-8665-965f6f0040e7 req-64423f54-1f5c-4dc5-b719-f563b5c90087 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:15.430103 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ca892f2e-6018-4ce4-8665-965f6f0040e7 req-64423f54-1f5c-4dc5-b719-f563b5c90087 service neutron] 10.222.0.11 "GET /v2.0/networks?id=435a0e3f-efcc-4b4f-9d00-e12d96978c86 HTTP/1.1" status: 200  len: 910 time: 0.1846724
May 27 09:35:15.504647 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaf470ca-f37f-4fd3-898d-88f87be6dc83 req-170078c3-2f18-4ec8-be12-748939010bd7 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:15.506097 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-aaf470ca-f37f-4fd3-898d-88f87be6dc83 req-170078c3-2f18-4ec8-be12-748939010bd7 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 945 time: 0.1902707
May 27 09:35:15.507096 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-ace8dd09-590f-400d-8905-5042323b8f9c req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] For port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:15.507492 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-ace8dd09-590f-400d-8905-5042323b8f9c req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:15.552671 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ca892f2e-6018-4ce4-8665-965f6f0040e7 req-63d5fb44-4c38-4ba9-be03-35c479bcc865 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9b310712-03d4-467f-a783-496f07c3b8fa HTTP/1.1" status: 200  len: 217 time: 0.1125376
May 27 09:35:15.638620 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-ace8dd09-590f-400d-8905-5042323b8f9c req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Calling delete_port for 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d owned by compute:nova {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:15.657469 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca892f2e-6018-4ce4-8665-965f6f0040e7 req-98a3ab68-69ec-488b-b6f5-e851b2f3ce30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:15.658927 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ca892f2e-6018-4ce4-8665-965f6f0040e7 req-98a3ab68-69ec-488b-b6f5-e851b2f3ce30 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f HTTP/1.1" status: 200  len: 849 time: 0.0894186
May 27 09:35:15.666168 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-aaf470ca-f37f-4fd3-898d-88f87be6dc83 req-f7275fb1-9dc3-452f-9b4b-b761105b00d9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/security-groups?id=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1204433
May 27 09:35:15.717227 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ca892f2e-6018-4ce4-8665-965f6f0040e7 req-66f440c7-9921-4a21-84f8-22f2594a93c4 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=435a0e3f-efcc-4b4f-9d00-e12d96978c86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0489550
May 27 09:35:15.753391 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ebfc59e-0799-487d-a5dd-c6fcac9efbe3 req-9b6fe6d6-4d2b-46ee-89ca-e1bb05429001 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:15.754901 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8ebfc59e-0799-487d-a5dd-c6fcac9efbe3 req-9b6fe6d6-4d2b-46ee-89ca-e1bb05429001 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 944 time: 0.2654586
May 27 09:35:15.785759 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-ace8dd09-590f-400d-8905-5042323b8f9c req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:15.794058 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-aa60e102-88fb-4821-836e-291c3fdd964e tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:15.882483 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8ebfc59e-0799-487d-a5dd-c6fcac9efbe3 req-8e54330e-5b0a-43b3-9e7c-5c37b7b93ad1 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1215360
May 27 09:35:15.919233 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ca892f2e-6018-4ce4-8665-965f6f0040e7 req-3fde9d7a-2aae-4836-b49f-0a73744e531e service neutron] 10.222.0.11 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1942408
May 27 09:35:15.950000 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event deleted for resources: {'Port': ['ID=9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:15.978025 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:16.029202 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-ace8dd09-590f-400d-8905-5042323b8f9c req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] No DVR routers for this DVR port 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d on host hv-cinder-77262 {{(pid=91820) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:35:16.031900 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-ace8dd09-590f-400d-8905-5042323b8f9c req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:16.034628 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'name': 'network-vif-deleted', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:35:16.056489 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ace8dd09-590f-400d-8905-5042323b8f9c req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.11 "DELETE /v2.0/ports/9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d HTTP/1.1" status: 204  len: 173 time: 0.8342907
May 27 09:35:16.072349 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ca892f2e-6018-4ce4-8665-965f6f0040e7 req-4db33b66-1d2c-407b-b1c2-5d1e94c4d570 service neutron] 10.222.0.11 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1462393
May 27 09:35:16.096359 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16228566-2bdd-40d4-9a6b-99952aa95d63', 'name': 'network-vif-deleted', 'tag': '9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d', 'status': 'completed', 'code': 200}
May 27 09:35:16.834312 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bef8f94b-8d03-4196-a757-16336f970797 req-ab3cfb93-d3c9-4150-bc0f-06d8277eb0f9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "GET /v2.0/ports?device_id=16228566-2bdd-40d4-9a6b-99952aa95d63 HTTP/1.1" status: 200  len: 210 time: 0.0432863
May 27 09:35:17.082280 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a77fb63-0c2a-47b3-8256-295a134db5ab req-10163758-99a6-463c-bc42-630300a1baa0 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:17.083774 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1a77fb63-0c2a-47b3-8256-295a134db5ab req-10163758-99a6-463c-bc42-630300a1baa0 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 944 time: 0.0894198
May 27 09:35:17.128647 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1a77fb63-0c2a-47b3-8256-295a134db5ab req-0eb11b78-ab04-4a98-b081-7fd57ec4ac74 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0391445
May 27 09:35:17.930527 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56412) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:18.001422 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4777a5e4-3c66-45ec-808f-14a0d9d93fc9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:18.032850 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4777a5e4-3c66-45ec-808f-14a0d9d93fc9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:18.102795 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4777a5e4-3c66-45ec-808f-14a0d9d93fc9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:18.108629 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-f2fac06e-f874-47c7-a555-33f41ff6058d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:18.228987 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4777a5e4-3c66-45ec-808f-14a0d9d93fc9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb8c2c8f-2cda-4331-ba72-b49f4c7550dd,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:18.233455 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-4777a5e4-3c66-45ec-808f-14a0d9d93fc9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:18.237876 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9b310712-03d4-467f-a783-496f07c3b8fa details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:35:18.238450 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4777a5e4-3c66-45ec-808f-14a0d9d93fc9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:18.239242 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-4777a5e4-3c66-45ec-808f-14a0d9d93fc9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] 10.222.0.30 "DELETE /v2.0/security-groups/bb8c2c8f-2cda-4331-ba72-b49f4c7550dd HTTP/1.1" status: 204  len: 168 time: 0.3077264
May 27 09:35:18.240274 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:18.285834 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56420) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:18.304680 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:18.305044 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9e8a5a43-534f-47ce-a5c0-2f2d3ad2040d not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:18.337840 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba981fe-b888-40c7-beb1-79dc9bef593c req-d2e6ef6d-2d1e-4871-a247-e72386ea65d5 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:18.344981 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2ba981fe-b888-40c7-beb1-79dc9bef593c req-d2e6ef6d-2d1e-4871-a247-e72386ea65d5 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 944 time: 0.1079443
May 27 09:35:18.388631 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2ba981fe-b888-40c7-beb1-79dc9bef593c req-81c2e3be-560d-4069-8193-554d9cf826b3 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0427353
May 27 09:35:18.472810 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9b310712-03d4-467f-a783-496f07c3b8fa, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9b310712-03d4-467f-a783-496f07c3b8fa,segment=NetworkSegment(94a48d31-baf7-45c2-bce8-12ad5cc3d6a7),segment_id=94a48d31-baf7-45c2-bce8-12ad5cc3d6a7)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:18.488401 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '9b310712-03d4-467f-a783-496f07c3b8fa', 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86', 'port_id': '9b310712-03d4-467f-a783-496f07c3b8fa', 'mac_address': 'fa:16:3e:f7:ea:ca', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 384, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:35:18.549632 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:18.569373 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9b310712-03d4-467f-a783-496f07c3b8fa {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:35:18.587004 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9b310712-03d4-467f-a783-496f07c3b8fa, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9b310712-03d4-467f-a783-496f07c3b8fa,segment=NetworkSegment(94a48d31-baf7-45c2-bce8-12ad5cc3d6a7),segment_id=94a48d31-baf7-45c2-bce8-12ad5cc3d6a7)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:18.592419 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:18.594714 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-77265e01-580c-41db-8096-8a660d058be7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:18.672394 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=9b310712-03d4-467f-a783-496f07c3b8fa,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:18.675847 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:18.809407 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['9b310712-03d4-467f-a783-496f07c3b8fa'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:35:18.930460 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3816697'] for router_interface, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:19.359329 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] Deleting port c03df627-c904-49cf-8192-55ef32975e9a {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:19.360068 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:19.489099 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] For port c03df627-c904-49cf-8192-55ef32975e9a, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=c03df627-c904-49cf-8192-55ef32975e9a,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:19.489459 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:19.592710 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a3725f-97a0-4ec9-9c63-fb973c1aa0e0 req-2c31bfef-3ba6-4e8f-a059-3105a31e4411 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:19.594323 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85a3725f-97a0-4ec9-9c63-fb973c1aa0e0 req-2c31bfef-3ba6-4e8f-a059-3105a31e4411 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 945 time: 0.0872817
May 27 09:35:19.618692 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] Calling delete_port for c03df627-c904-49cf-8192-55ef32975e9a owned by network:router_interface {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:19.642706 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85a3725f-97a0-4ec9-9c63-fb973c1aa0e0 req-7548ac75-cd70-461b-8ba7-9e2f7318e45f tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422664
May 27 09:35:19.876823 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:19.881062 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-831e682e-c3c8-46b3-8b70-0a95eebd1309 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:19.928499 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] Pushing event deleted for resources: {'Port': ['ID=c03df627-c904-49cf-8192-55ef32975e9a,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:19.931739 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:20.207994 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3683824', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3812169'] for router_interface, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:20.244492 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9b310712-03d4-467f-a783-496f07c3b8fa up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:35:20.330825 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 9b310712-03d4-467f-a783-496f07c3b8fa completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:35:20.336453 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 9b310712-03d4-467f-a783-496f07c3b8fa triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:35:20.336836 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:20.501510 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:20.535554 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ddaa8be2-8193-4629-b53a-ddb9a5b75804', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b310712-03d4-467f-a783-496f07c3b8fa'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:35:20.548929 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 9b310712-03d4-467f-a783-496f07c3b8fa, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9b310712-03d4-467f-a783-496f07c3b8fa,segment=NetworkSegment(94a48d31-baf7-45c2-bce8-12ad5cc3d6a7),segment_id=94a48d31-baf7-45c2-bce8-12ad5cc3d6a7)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:20.553076 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:20.556162 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:20.611992 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ddaa8be2-8193-4629-b53a-ddb9a5b75804', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9b310712-03d4-467f-a783-496f07c3b8fa', 'code': 200}
May 27 09:35:20.640431 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=9b310712-03d4-467f-a783-496f07c3b8fa,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:20.645262 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:20.688299 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] Router 9a650133-6433-44b6-9741-b3bd050216ae has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:35:20.897011 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:35:20.908103 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3888db61-69b9-4948-9b57-56ae8e9323e2 None None] Sync routers for ids ['9a650133-6433-44b6-9741-b3bd050216ae'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:35:20.913381 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c773568d-e6d1-44d0-9b23-e6ac0f2e2309 req-f41fc235-97a4-4892-8da1-fe6f487f2e2e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:20.914804 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-52d766ed-868a-47d4-a7bc-495d9bf7ad2b admin admin] 10.222.0.30 "PUT /v2.0/routers/9a650133-6433-44b6-9741-b3bd050216ae/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6277261
May 27 09:35:20.915100 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c773568d-e6d1-44d0-9b23-e6ac0f2e2309 req-f41fc235-97a4-4892-8da1-fe6f487f2e2e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 946 time: 0.1513195
May 27 09:35:20.915397 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56434) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:20.919086 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3888db61-69b9-4948-9b57-56ae8e9323e2 None None] Routers {'9a650133-6433-44b6-9741-b3bd050216ae'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:35:20.919785 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-3888db61-69b9-4948-9b57-56ae8e9323e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecec4e20>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['9a650133-6433-44b6-9741-b3bd050216ae'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:21.004424 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82dc02c7-1046-499c-b5fa-f4f5f64c18b8 req-8e790b21-274d-4638-a21d-1c7ee48f861e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:21.005884 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-82dc02c7-1046-499c-b5fa-f4f5f64c18b8 req-8e790b21-274d-4638-a21d-1c7ee48f861e service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 1099 time: 0.2083461
May 27 09:35:21.110477 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-3888db61-69b9-4948-9b57-56ae8e9323e2 None None] Set router 9a650133-6433-44b6-9741-b3bd050216ae gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:35:21.154785 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-c773568d-e6d1-44d0-9b23-e6ac0f2e2309 req-955d6614-d2f2-4166-814f-2a160b9c9b3f tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1754248
May 27 09:35:21.165545 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-82dc02c7-1046-499c-b5fa-f4f5f64c18b8 req-d1e78ecd-7ae5-47b6-9b9e-56aebfb63b61 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1463706
May 27 09:35:21.186642 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Notify callbacks [] for router, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:21.397482 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:21.471827 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-3888db61-69b9-4948-9b57-56ae8e9323e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecec4e20>, [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21'}], 'enable_snat': True}, 'gw_port_id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:35:19Z', 'revision_number': 5, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port': {'id': '0137aec9-4829-4ec4-ac35-42db2874bf00', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c1:10:59', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a650133-6433-44b6-9741-b3bd050216ae', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.21', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:02Z', 'updated_at': '2021-05-27T09:29:10Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:21.476418 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3888db61-69b9-4948-9b57-56ae8e9323e2 None None] Checking router: 9a650133-6433-44b6-9741-b3bd050216ae for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:35:21.487656 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3888db61-69b9-4948-9b57-56ae8e9323e2 None None] Routers {'9a650133-6433-44b6-9741-b3bd050216ae'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:35:21.488659 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-3888db61-69b9-4948-9b57-56ae8e9323e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecec4e20>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['9a650133-6433-44b6-9741-b3bd050216ae'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:21.491838 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Deleting port 0137aec9-4829-4ec4-ac35-42db2874bf00 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:21.492224 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:21.634301 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] For port 0137aec9-4829-4ec4-ac35-42db2874bf00, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=0137aec9-4829-4ec4-ac35-42db2874bf00,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:21.634668 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:21.658866 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-3888db61-69b9-4948-9b57-56ae8e9323e2 None None] Set router 9a650133-6433-44b6-9741-b3bd050216ae gateway port host: None {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:35:21.767556 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Calling delete_port for 0137aec9-4829-4ec4-ac35-42db2874bf00 owned by network:router_gateway {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:21.769893 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-3888db61-69b9-4948-9b57-56ae8e9323e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecec4e20>, [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:35:21Z', 'revision_number': 6, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port_host': None}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:21.774842 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3888db61-69b9-4948-9b57-56ae8e9323e2 None None] The sync data for ids ['9a650133-6433-44b6-9741-b3bd050216ae'] in dv-cinder-772623-6-iscsi is: [{'id': '9a650133-6433-44b6-9741-b3bd050216ae', 'name': 'tempest-TestShelveInstance-470552088-router', 'tenant_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:01Z', 'updated_at': '2021-05-27T09:35:21Z', 'revision_number': 6, 'project_id': 'a31154df1ce4420f9bdf53b8b3b3649e', 'gw_port_host': None}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:35:21.938407 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:21.945964 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8cdbfb29-e04e-40d1-99e8-b139d5b09a32 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:21.991856 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Pushing event deleted for resources: {'Port': ['ID=0137aec9-4829-4ec4-ac35-42db2874bf00,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:22.027026 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:22.092641 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3811286'] for router_gateway, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:22.454015 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3812681', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2009'] for router, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:22.457153 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:22.499167 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3812965'] for router, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:22.499629 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9a650133-6433-44b6-9741-b3bd050216ae {{(pid=91821) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 27 09:35:22.519625 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d911a297-121c-4558-b212-dc599c7b0214 req-4aa9902e-3ac1-4e30-a315-fbac7c63b1ff tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:22.521226 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d911a297-121c-4558-b212-dc599c7b0214 req-4aa9902e-3ac1-4e30-a315-fbac7c63b1ff tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 946 time: 0.1878045
May 27 09:35:22.544889 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Notify callbacks [] for router, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:22.546038 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] 10.222.0.30 "DELETE /v2.0/routers/9a650133-6433-44b6-9741-b3bd050216ae HTTP/1.1" status: 204  len: 168 time: 1.6287682
May 27 09:35:22.548545 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56442) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:22.628249 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d911a297-121c-4558-b212-dc599c7b0214 req-5ea2e456-6113-4dc5-bec5-7e6377bef539 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0999658
May 27 09:35:22.639439 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_v2 [None req-60de10ca-78e6-4bd1-90a1-2cbbeb8f7361 admin admin] Deleting subnet 6659533b-b3b0-4d3c-8bf0-709a19b7728d {{(pid=91821) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:35:22.644313 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-60de10ca-78e6-4bd1-90a1-2cbbeb8f7361 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:22.655093 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device c03df627-c904-49cf-8192-55ef32975e9a no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:22.705288 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-60de10ca-78e6-4bd1-90a1-2cbbeb8f7361 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2232147'] for subnet, precommit_delete_associations {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:22.714722 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: c03df627-c904-49cf-8192-55ef32975e9a {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:22.715420 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device c03df627-c904-49cf-8192-55ef32975e9a not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:22.716070 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 0137aec9-4829-4ec4-ac35-42db2874bf00 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:22.789968 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 0137aec9-4829-4ec4-ac35-42db2874bf00 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:22.790682 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 0137aec9-4829-4ec4-ac35-42db2874bf00 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:22.810121 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-60de10ca-78e6-4bd1-90a1-2cbbeb8f7361 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:23.165128 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-60de10ca-78e6-4bd1-90a1-2cbbeb8f7361 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2158057', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2399650'] for subnet, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:23.170008 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-731b402a-89b4-499f-80bb-7c710e56b074 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:23.206808 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60de10ca-78e6-4bd1-90a1-2cbbeb8f7361 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6659533b-b3b0-4d3c-8bf0-709a19b7728d,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:23.209802 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-60de10ca-78e6-4bd1-90a1-2cbbeb8f7361 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:23.213128 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-60de10ca-78e6-4bd1-90a1-2cbbeb8f7361 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:23.219075 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3f2ca717-12de-43ae-bfda-9ff9aa44cd4b None None] Network 1f49b134-af0c-46a8-b862-f6cb6b6a0bba requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:35:23.221441 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-60de10ca-78e6-4bd1-90a1-2cbbeb8f7361 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/6659533b-b3b0-4d3c-8bf0-709a19b7728d HTTP/1.1" status: 204  len: 168 time: 0.6716316
May 27 09:35:23.223828 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56452) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:23.361478 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:23.451110 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Deleting port 32714a80-7bbc-4667-b4b7-e4274ceab763 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:23.451401 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:23.578529 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] For port 32714a80-7bbc-4667-b4b7-e4274ceab763, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=32714a80-7bbc-4667-b4b7-e4274ceab763,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:23.578799 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:23.581062 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6dd68c5c-5f8b-45f3-9141-63add1f20deb None None] DHCP port deletion for 1f49b134-af0c-46a8-b862-f6cb6b6a0bba request from dv-cinder-772623-6-iscsi {{(pid=91822) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 27 09:35:23.678222 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-6dd68c5c-5f8b-45f3-9141-63add1f20deb None None] Deleting port 32714a80-7bbc-4667-b4b7-e4274ceab763 {{(pid=91822) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:23.678909 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-6dd68c5c-5f8b-45f3-9141-63add1f20deb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:23.729048 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Calling delete_port for 32714a80-7bbc-4667-b4b7-e4274ceab763 owned by network:dhcp {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:23.813510 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:23.817491 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:23.837503 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-6dd68c5c-5f8b-45f3-9141-63add1f20deb None None] For port 32714a80-7bbc-4667-b4b7-e4274ceab763, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=32714a80-7bbc-4667-b4b7-e4274ceab763,segment=NetworkSegment(c23b4556-4fa1-45f3-b823-f454f9da8056),segment_id=c23b4556-4fa1-45f3-b823-f454f9da8056)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:23.838268 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-6dd68c5c-5f8b-45f3-9141-63add1f20deb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:23.961423 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Pushing event deleted for resources: {'Port': ['ID=32714a80-7bbc-4667-b4b7-e4274ceab763,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:23.964852 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:23.973816 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] No DVR routers for this DVR port 32714a80-7bbc-4667-b4b7-e4274ceab763 on host dv-cinder-772623-6-iscsi {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:35:24.057625 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-6dd68c5c-5f8b-45f3-9141-63add1f20deb None None] Calling delete_port for 32714a80-7bbc-4667-b4b7-e4274ceab763 owned by network:dhcp {{(pid=91822) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:24.110881 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-6dd68c5c-5f8b-45f3-9141-63add1f20deb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116'] for port, after_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:24.122456 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-f25ccf27-3734-4f4b-9441-fa9abd8b1310 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.002s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:24.140746 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:24.163832 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2ee6c73730>,) {'filters': {'network_id': ['1f49b134-af0c-46a8-b862-f6cb6b6a0bba']}} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:24.166470 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dd68c5c-5f8b-45f3-9141-63add1f20deb None None] Pushing event deleted for resources: {'Port': ['ID=32714a80-7bbc-4667-b4b7-e4274ceab763,revision_number=None']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:24.169703 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dd68c5c-5f8b-45f3-9141-63add1f20deb None None] No DVR routers for this DVR port 32714a80-7bbc-4667-b4b7-e4274ceab763 on host dv-cinder-772623-6-iscsi {{(pid=91822) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:35:24.171169 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-6dd68c5c-5f8b-45f3-9141-63add1f20deb None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:24.287939 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee6c73730>, 'c23b4556-4fa1-45f3-b823-f454f9da8056') {'for_net_delete': True} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:24.288634 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee6c73730>, 'c23b4556-4fa1-45f3-b823-f454f9da8056') {} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:24.306779 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5f63221-df21-4663-ab9c-a95ba1e53b9b req-97492aec-aa61-4df4-9267-b001125d187f tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:24.308571 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a5f63221-df21-4663-ab9c-a95ba1e53b9b req-97492aec-aa61-4df4-9267-b001125d187f tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 946 time: 0.4245555
May 27 09:35:24.314777 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2232170'] for segment, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:24.366173 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:24.380838 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Releasing vlan 381 on physical network physnet1 to pool {{(pid=91821) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:35:24.381244 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2157387'] for segment, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]: Traceback (most recent call last):
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     timer()
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     cb(*args, **kw)
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     return func(*args, **kwargs)
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     self._notify()
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     self.callback(batched_events)
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     event.method(event)
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     return f(self, *a, **k)
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._get(url).json()
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self.request(url, 'GET', **kwargs)
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:35:24.395344 dv-cinder-772623-6-iscsi neutron-server[91821]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:35:24.403422 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a5f63221-df21-4663-ab9c-a95ba1e53b9b req-a77edf16-fe38-4f0e-8f82-1d63c4ddf79f tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0786545
May 27 09:35:24.439331 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 32714a80-7bbc-4667-b4b7-e4274ceab763 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:24.478160 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 32714a80-7bbc-4667-b4b7-e4274ceab763 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:24.478552 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 32714a80-7bbc-4667-b4b7-e4274ceab763 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:24.506488 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:24.510099 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:24.523551 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:24.536425 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Pushing event deleted for resources: {'Network': ['ID=1f49b134-af0c-46a8-b862-f6cb6b6a0bba,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:24.548780 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.549057 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.549434 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.549792 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.550155 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.550516 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.550872 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.551226 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.551625 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.552014 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.552310 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.552661 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:35:24.556300 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] 10.222.0.30 "DELETE /v2.0/networks/1f49b134-af0c-46a8-b862-f6cb6b6a0bba HTTP/1.1" status: 204  len: 168 time: 1.3313348
May 27 09:35:24.557301 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:24.559688 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56464) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:25.232785 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6209160-eb86-4570-ad4a-c7e91a841218 req-7dbb9a94-72b4-4da3-999e-a31f21720652 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:25.234265 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b6209160-eb86-4570-ad4a-c7e91a841218 req-7dbb9a94-72b4-4da3-999e-a31f21720652 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.11 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 946 time: 0.1276484
May 27 09:35:25.483006 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-b6209160-eb86-4570-ad4a-c7e91a841218 req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Deleting port 9b310712-03d4-467f-a783-496f07c3b8fa {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:25.483006 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-b6209160-eb86-4570-ad4a-c7e91a841218 req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:25.528027 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3816697'] for router_interface, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:25.576225 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d10546-85a5-4c0b-be7d-ce6c814fbdac req-fadcc100-2648-451f-b66e-95ed885fe558 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:25.578087 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f2d10546-85a5-4c0b-be7d-ce6c814fbdac req-fadcc100-2648-451f-b66e-95ed885fe558 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 946 time: 0.2131405
May 27 09:35:25.730376 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f2d10546-85a5-4c0b-be7d-ce6c814fbdac req-12e58bc3-430f-475f-af58-f50feb22ab19 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1012201
May 27 09:35:25.743969 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-b6209160-eb86-4570-ad4a-c7e91a841218 req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] For port 9b310712-03d4-467f-a783-496f07c3b8fa, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9b310712-03d4-467f-a783-496f07c3b8fa,segment=NetworkSegment(94a48d31-baf7-45c2-bce8-12ad5cc3d6a7),segment_id=94a48d31-baf7-45c2-bce8-12ad5cc3d6a7)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:25.744395 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-b6209160-eb86-4570-ad4a-c7e91a841218 req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:25.881790 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbaf3f1d-b454-419a-b1ce-5d41e22426bc req-f4e44267-940d-4b1f-808b-bf48dcebcee7 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:25.883388 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fbaf3f1d-b454-419a-b1ce-5d41e22426bc req-f4e44267-940d-4b1f-808b-bf48dcebcee7 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 946 time: 0.3219774
May 27 09:35:25.890809 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-b6209160-eb86-4570-ad4a-c7e91a841218 req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Calling delete_port for 9b310712-03d4-467f-a783-496f07c3b8fa owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:25.951804 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fbaf3f1d-b454-419a-b1ce-5d41e22426bc req-1a179156-8578-4d6f-9cab-fdc3b428754e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0573924
May 27 09:35:26.004217 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] Deleting port 4da93041-8802-409a-a1ac-d2b7a1501378 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:26.004764 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:26.059999 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-b6209160-eb86-4570-ad4a-c7e91a841218 req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:26.065740 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a19cb2c4-3789-4c12-b2ac-06cffae1ffc0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:26.072170 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['9b310712-03d4-467f-a783-496f07c3b8fa'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:35:26.123472 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Pushing event deleted for resources: {'Port': ['ID=9b310712-03d4-467f-a783-496f07c3b8fa,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:26.126104 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:26.162386 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] For port 4da93041-8802-409a-a1ac-d2b7a1501378, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=4da93041-8802-409a-a1ac-d2b7a1501378,segment=NetworkSegment(fb3bb56f-e851-4dc9-a059-75ed93004f61),segment_id=fb3bb56f-e851-4dc9-a059-75ed93004f61)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:26.162744 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:26.204128 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6209160-eb86-4570-ad4a-c7e91a841218 req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] No DVR routers for this DVR port 9b310712-03d4-467f-a783-496f07c3b8fa on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:35:26.206701 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-b6209160-eb86-4570-ad4a-c7e91a841218 req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:26.209669 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ddaa8be2-8193-4629-b53a-ddb9a5b75804', 'name': 'network-vif-deleted', 'tag': '9b310712-03d4-467f-a783-496f07c3b8fa'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:35:26.230665 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b6209160-eb86-4570-ad4a-c7e91a841218 req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.11 "DELETE /v2.0/ports/9b310712-03d4-467f-a783-496f07c3b8fa HTTP/1.1" status: 204  len: 173 time: 0.9885259
May 27 09:35:26.265223 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ddaa8be2-8193-4629-b53a-ddb9a5b75804', 'name': 'network-vif-deleted', 'tag': '9b310712-03d4-467f-a783-496f07c3b8fa', 'status': 'completed', 'code': 200}
May 27 09:35:26.300469 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] Calling delete_port for 4da93041-8802-409a-a1ac-d2b7a1501378 owned by network:router_interface {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:26.432668 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:26.470082 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:26.474005 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ef7d15c8-41b3-4d78-a51e-48a8bf41d2aa tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:26.520858 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] Pushing event deleted for resources: {'Port': ['ID=4da93041-8802-409a-a1ac-d2b7a1501378,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:26.523417 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:26.573352 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-fd743cf7-0590-430f-a5b0-b7ef1bf0fef0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:26.575117 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-fd743cf7-0590-430f-a5b0-b7ef1bf0fef0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.11 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 946 time: 0.0967641
May 27 09:35:26.741967 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Deleting port bd7e74f7-d502-4ed5-b38d-566afcb0be1a {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:26.742318 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:26.841790 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3683824', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3812169'] for router_interface, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:26.892647 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] For port bd7e74f7-d502-4ed5-b38d-566afcb0be1a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:26.893760 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:27.223990 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-799d2697-42dd-4579-8702-51bfe811cdc5 req-503a3a6b-a6a1-4044-ae5f-2a2cb3e02d6c tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Synchronizing usage tracker for tenant:df5fdd9e30044571812bfe2cc2233af6 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:35:27.328959 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d217d0c-e8eb-4a06-84e8-7f1c5e966246 req-bb57288d-9e53-404c-ac24-7f0723b07d47 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:27.330507 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0d217d0c-e8eb-4a06-84e8-7f1c5e966246 req-bb57288d-9e53-404c-ac24-7f0723b07d47 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 946 time: 0.4401026
May 27 09:35:27.334353 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-799d2697-42dd-4579-8702-51bfe811cdc5 req-503a3a6b-a6a1-4044-ae5f-2a2cb3e02d6c tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Unset dirty status for tenant:df5fdd9e30044571812bfe2cc2233af6 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:35:27.335496 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-799d2697-42dd-4579-8702-51bfe811cdc5 req-503a3a6b-a6a1-4044-ae5f-2a2cb3e02d6c tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=ddaa8be2-8193-4629-b53a-ddb9a5b75804 HTTP/1.1" status: 200  len: 210 time: 0.1846666
May 27 09:35:27.379572 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] Router 661f4e35-828e-4be3-8181-3d1a1d92c170 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:35:27.480477 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0d217d0c-e8eb-4a06-84e8-7f1c5e966246 req-f2523a35-00fc-4cf3-8f7b-a5043e0d1e04 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups?id=3f848da4-f4c2-436d-acc8-dc0cd5d695b1&fields=id&fields=name HTTP/1.1" status: 200  len: 312 time: 0.1384995
May 27 09:35:27.488164 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:27.488548 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:27.488869 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.l3_db [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Floating IP bd184371-ce98-4013-aa95-667c89febf8f disassociated. External IP: 172.27.1.74, port: bd7e74f7-d502-4ed5-b38d-566afcb0be1a.
May 27 09:35:27.489314 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Calling delete_port for bd7e74f7-d502-4ed5-b38d-566afcb0be1a owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:27.577068 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:35:27.587556 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8ab7350-154a-41b0-afe3-82f0c2796af4 None None] Sync routers for ids ['661f4e35-828e-4be3-8181-3d1a1d92c170'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:35:27.599456 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-78856dbf-07d1-498c-afb9-7b9cb9e9a3a7 admin admin] 10.222.0.30 "PUT /v2.0/routers/661f4e35-828e-4be3-8181-3d1a1d92c170/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 3.0384753
May 27 09:35:27.601776 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8ab7350-154a-41b0-afe3-82f0c2796af4 None None] Routers {'661f4e35-828e-4be3-8181-3d1a1d92c170'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:35:27.601937 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56486) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:27.603117 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-b8ab7350-154a-41b0-afe3-82f0c2796af4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eedb82730>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['661f4e35-828e-4be3-8181-3d1a1d92c170'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:27.698008 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:27.705061 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:27.758911 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event deleted for resources: {'Port': ['ID=bd7e74f7-d502-4ed5-b38d-566afcb0be1a,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:27.796581 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-b8ab7350-154a-41b0-afe3-82f0c2796af4 None None] Set router 661f4e35-828e-4be3-8181-3d1a1d92c170 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:35:27.816397 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.111s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:27.926859 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Notify callbacks [] for router, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:28.099958 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-b8ab7350-154a-41b0-afe3-82f0c2796af4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eedb82730>, [{'id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'name': 'tempest-TestShelveInstance-710346399-router', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:12Z', 'updated_at': '2021-05-27T09:35:26Z', 'revision_number': 5, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'gw_port': {'id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:04:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_gateway', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:13Z', 'updated_at': '2021-05-27T09:29:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:28.103738 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8ab7350-154a-41b0-afe3-82f0c2796af4 None None] Checking router: 661f4e35-828e-4be3-8181-3d1a1d92c170 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:35:28.115123 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b8ab7350-154a-41b0-afe3-82f0c2796af4 None None] Routers {'661f4e35-828e-4be3-8181-3d1a1d92c170'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:35:28.117130 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-b8ab7350-154a-41b0-afe3-82f0c2796af4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eedb82730>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['661f4e35-828e-4be3-8181-3d1a1d92c170'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:28.182431 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:35:28.198029 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:28.283055 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device bd7e74f7-d502-4ed5-b38d-566afcb0be1a no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:28.334489 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: bd7e74f7-d502-4ed5-b38d-566afcb0be1a {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:28.334978 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device bd7e74f7-d502-4ed5-b38d-566afcb0be1a not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:28.335528 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9b310712-03d4-467f-a783-496f07c3b8fa no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:28.379812 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 9b310712-03d4-467f-a783-496f07c3b8fa {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:28.380478 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9b310712-03d4-467f-a783-496f07c3b8fa not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:28.408798 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-b8ab7350-154a-41b0-afe3-82f0c2796af4 None None] Set router 661f4e35-828e-4be3-8181-3d1a1d92c170 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:35:28.474676 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Deleting port 810b9568-53a3-46b7-a25b-7d6c73eee345 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:28.475022 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:28.503089 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:35:28.516881 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-756fc456-5594-488a-895d-e0e494e178de None None] Sync routers for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:35:28.544484 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-756fc456-5594-488a-895d-e0e494e178de None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:35:28.545175 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-756fc456-5594-488a-895d-e0e494e178de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed05a340>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:28.795991 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-756fc456-5594-488a-895d-e0e494e178de None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:35:28.876627 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-b8ab7350-154a-41b0-afe3-82f0c2796af4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eedb82730>, [{'id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'name': 'tempest-TestShelveInstance-710346399-router', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:12Z', 'updated_at': '2021-05-27T09:35:26Z', 'revision_number': 5, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'gw_port': {'id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:04:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_gateway', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:13Z', 'updated_at': '2021-05-27T09:29:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:28.884889 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8ab7350-154a-41b0-afe3-82f0c2796af4 None None] The sync data for ids ['661f4e35-828e-4be3-8181-3d1a1d92c170'] in dv-cinder-772623-6-iscsi is: [{'id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'name': 'tempest-TestShelveInstance-710346399-router', 'tenant_id': '8fa04a9552394b50b0cef7e35b83a87c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50'}], 'enable_snat': True}, 'gw_port_id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:29:12Z', 'updated_at': '2021-05-27T09:35:26Z', 'revision_number': 5, 'project_id': '8fa04a9552394b50b0cef7e35b83a87c', 'gw_port': {'id': '810b9568-53a3-46b7-a25b-7d6c73eee345', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:37:04:44', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '661f4e35-828e-4be3-8181-3d1a1d92c170', 'device_owner': 'network:router_gateway', 'standard_attr_id': 287, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.50', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:29:13Z', 'updated_at': '2021-05-27T09:29:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:35:28.901418 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-d38f2195-02b3-4b7a-aa57-8b54c2d013f6 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1296120
May 27 09:35:28.948273 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b3586843-4029-46c7-b43d-4898fdd8b9a6 req-991a3052-6add-4dcb-800b-7e2ab7010341 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/ports?device_id=652a6c44-8948-4153-be12-c818fc126b19 HTTP/1.1" status: 200  len: 210 time: 0.1965308
May 27 09:35:28.960194 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] No DVR routers for this DVR port bd7e74f7-d502-4ed5-b38d-566afcb0be1a on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:35:28.967566 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:28.973211 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'name': 'network-vif-deleted', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:35:29.012468 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7a970f71-d1f7-46fb-b8ce-0343de6472df req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.11 "DELETE /v2.0/ports/bd7e74f7-d502-4ed5-b38d-566afcb0be1a HTTP/1.1" status: 204  len: 173 time: 2.4309430
May 27 09:35:29.030813 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '652a6c44-8948-4153-be12-c818fc126b19', 'name': 'network-vif-deleted', 'tag': 'bd7e74f7-d502-4ed5-b38d-566afcb0be1a', 'status': 'completed', 'code': 200}
May 27 09:35:29.073577 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] For port 810b9568-53a3-46b7-a25b-7d6c73eee345, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=810b9568-53a3-46b7-a25b-7d6c73eee345,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:29.074197 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:29.097460 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-a17ca99c-5abf-40da-b322-0c72ad07632b tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:29.099204 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-a17ca99c-5abf-40da-b322-0c72ad07632b tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/networks?id=435a0e3f-efcc-4b4f-9d00-e12d96978c86 HTTP/1.1" status: 200  len: 809 time: 0.3495524
May 27 09:35:29.126068 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-fd04a9d4-51fb-4b1d-b291-9156dca12d96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:29.127609 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-fd04a9d4-51fb-4b1d-b291-9156dca12d96 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 1099 time: 0.1143806
May 27 09:35:29.198308 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-756fc456-5594-488a-895d-e0e494e178de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed05a340>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:29.206019 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-756fc456-5594-488a-895d-e0e494e178de None None] Checking router: a7747f73-c1a4-4a6c-8c93-cf80d93a5583 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:35:29.217996 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-756fc456-5594-488a-895d-e0e494e178de None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:35:29.218918 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-756fc456-5594-488a-895d-e0e494e178de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed05a340>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:29.225673 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Calling delete_port for 810b9568-53a3-46b7-a25b-7d6c73eee345 owned by network:router_gateway {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:29.234058 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-c0adb056-d736-459f-9d2b-e9ef5ea33df6 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/quotas/df5fdd9e30044571812bfe2cc2233af6 HTTP/1.1" status: 200  len: 375 time: 0.0795066
May 27 09:35:29.318600 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-4a08e568-f35c-4797-bff7-a6432c970fa6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:29.320132 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-4a08e568-f35c-4797-bff7-a6432c970fa6 service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.1714416
May 27 09:35:29.347666 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-831358d6-b859-432d-9dea-2ec7c56138fc tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=df5fdd9e30044571812bfe2cc2233af6&fields=id HTTP/1.1" status: 200  len: 210 time: 0.1044447
May 27 09:35:29.469823 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-90a7a4a2-e3fc-440c-afca-71837efbaf94 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9734bd01-bec4-4629-a99e-36b3d4950146 HTTP/1.1" status: 200  len: 1002 time: 0.1380684
May 27 09:35:29.493118 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-756fc456-5594-488a-895d-e0e494e178de None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:35:29.525912 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-5b249409-b97d-4ac8-a027-1e24a1c53560 service neutron] 10.222.0.30 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1773417
May 27 09:35:29.558135 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-21ee1035-ae22-43e1-8e46-708f268bfe5c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:29.559832 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-21ee1035-ae22-43e1-8e46-708f268bfe5c service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0821111
May 27 09:35:29.672188 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-22adcf8a-f6fe-40fc-ae50-c0e0f3bf8697 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:29.672188 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-22adcf8a-f6fe-40fc-ae50-c0e0f3bf8697 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1010878
May 27 09:35:29.759721 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:29.783874 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a8a85211-5313-4378-9214-7b1dc2f73bb2 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:29.848002 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-73c7a089-5418-4175-b924-5250540384f6 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1701107
May 27 09:35:29.867651 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-87a1456d-01e3-4c25-9412-73f50876013f service neutron] 10.222.0.30 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3329318
May 27 09:35:29.874291 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Pushing event deleted for resources: {'Port': ['ID=810b9568-53a3-46b7-a25b-7d6c73eee345,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:29.877907 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:29.918631 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-756fc456-5594-488a-895d-e0e494e178de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed05a340>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:29.923306 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-756fc456-5594-488a-895d-e0e494e178de None None] The sync data for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi is: [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:27:28Z', 'revision_number': 4, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '7515b299-be21-49ae-9c90-975237275947', 'name': '', 'network_id': '624aa867-a71e-4343-8899-4e49257cd000', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'mac_address': 'fa:16:3e:bb:d0:75', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_interface', 'standard_attr_id': 101, 'fixed_ips': [{'subnet_id': '77149737-85de-41af-b8e2-0509a46f467d', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:23Z', 'updated_at': '2021-05-27T09:27:45Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'subnets': [{'id': '77149737-85de-41af-b8e2-0509a46f467d', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:35:29.955051 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3811286'] for router_gateway, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:30.183285 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ed071a6a-6cae-45e1-9b55-37b3b9ec86ae req-ec345257-56cb-41a6-b7ba-690fde4303c5 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3268957
May 27 09:35:30.200617 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56516) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:30.237823 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0633bcb8-fd2d-4797-b3e4-efdbce3efaa2 req-bdff3f2f-ba64-48bf-a45a-94e1b7fd415e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 210 time: 0.0625494
May 27 09:35:30.242973 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3812681', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2009'] for router, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:30.245616 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:30.287223 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3812965'] for router, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:30.287988 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Fanout notify agent at l3_agent the message router_deleted on router 661f4e35-828e-4be3-8181-3d1a1d92c170 {{(pid=91821) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 27 09:35:30.304605 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] Notify callbacks [] for router, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:30.306214 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-508a8fea-c982-45d5-8776-bff96e114eeb admin admin] 10.222.0.30 "DELETE /v2.0/routers/661f4e35-828e-4be3-8181-3d1a1d92c170 HTTP/1.1" status: 204  len: 168 time: 2.7031481
May 27 09:35:30.310431 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56524) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:30.313833 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2e33ab3d-8714-40d4-a7c3-6290c40f1e70 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:30.375710 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2e33ab3d-8714-40d4-a7c3-6290c40f1e70 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:30.410222 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_v2 [None req-49ab66e1-5868-4408-a17e-a80bd81e1725 admin admin] Deleting subnet c6ee1048-84dd-4c7a-bd51-e1a97abf20e5 {{(pid=91821) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:35:30.422746 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6bd69df-e9ec-46c3-a348-f46de10eca73 None None] New status for floating IP bd184371-ce98-4013-aa95-667c89febf8f: DOWN {{(pid=91822) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:35:30.439305 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-49ab66e1-5868-4408-a17e-a80bd81e1725 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:30.467256 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2e33ab3d-8714-40d4-a7c3-6290c40f1e70 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:30.483640 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e4b7eadb-097f-44ed-ab4b-6b39ad73f592 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:30.499337 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e33ab3d-8714-40d4-a7c3-6290c40f1e70 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f848da4-f4c2-436d-acc8-dc0cd5d695b1,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:30.505464 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2e33ab3d-8714-40d4-a7c3-6290c40f1e70 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:30.507715 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2e33ab3d-8714-40d4-a7c3-6290c40f1e70 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:30.513152 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56530) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:30.515341 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-2e33ab3d-8714-40d4-a7c3-6290c40f1e70 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "DELETE /v2.0/security-groups/3f848da4-f4c2-436d-acc8-dc0cd5d695b1 HTTP/1.1" status: 204  len: 168 time: 0.3103971
May 27 09:35:30.538824 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 4da93041-8802-409a-a1ac-d2b7a1501378 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:30.630947 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 4da93041-8802-409a-a1ac-d2b7a1501378 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:30.631721 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 4da93041-8802-409a-a1ac-d2b7a1501378 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:30.695676 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.api.v2.resource [None req-a1e0025a-046e-458c-8553-26535261269b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] show failed (client error): The resource could not be found.
May 27 09:35:30.702646 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-a1e0025a-046e-458c-8553-26535261269b tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "GET /v2.0/security-groups/3f848da4-f4c2-436d-acc8-dc0cd5d695b1 HTTP/1.1" status: 404  len: 347 time: 0.1881495
May 27 09:35:30.703349 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56534) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:30.724957 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-49ab66e1-5868-4408-a17e-a80bd81e1725 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2232147'] for subnet, precommit_delete_associations {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:30.828272 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-49ab66e1-5868-4408-a17e-a80bd81e1725 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:31.161055 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Deleting port 1eca5e85-1780-4a06-acb9-4adebee714f4 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:31.161409 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:31.204176 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-49ab66e1-5868-4408-a17e-a80bd81e1725 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2158057', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2399650'] for subnet, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:31.209586 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:31.259780 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49ab66e1-5868-4408-a17e-a80bd81e1725 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c6ee1048-84dd-4c7a-bd51-e1a97abf20e5,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:31.263868 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-49ab66e1-5868-4408-a17e-a80bd81e1725 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:31.264892 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-49ab66e1-5868-4408-a17e-a80bd81e1725 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:31.274852 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-49ab66e1-5868-4408-a17e-a80bd81e1725 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/c6ee1048-84dd-4c7a-bd51-e1a97abf20e5 HTTP/1.1" status: 204  len: 168 time: 0.9638762
May 27 09:35:31.275060 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-579f0a34-7ed6-4b8d-93d0-39ea574de75d None None] Network 93808fcf-da41-473a-b8e5-03797225e7ce requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:35:31.275794 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56540) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:31.315107 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:31.319813 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:31.497583 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dbf58929-9def-48e6-b78e-7a4607f78910 req-7a20a44a-10f0-49ac-92e4-96f2a177ef28 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 210 time: 0.1013136
May 27 09:35:31.523894 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Calling delete_port for 1eca5e85-1780-4a06-acb9-4adebee714f4 owned by network:floatingip {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:31.552794 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:31.676285 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Deleting port bae10c78-85a6-404c-bdbc-073e28e2353f {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:31.676425 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:31.682598 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e404ad3-a675-48ed-9e52-5110200f67ce None None] DHCP port deletion for 93808fcf-da41-473a-b8e5-03797225e7ce request from dv-cinder-772623-6-iscsi {{(pid=91822) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 27 09:35:31.768815 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-aac24eb8-4509-418e-be19-07110a069660 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:31.770385 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-aac24eb8-4509-418e-be19-07110a069660 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.11 "GET /v2.0/networks?id=435a0e3f-efcc-4b4f-9d00-e12d96978c86 HTTP/1.1" status: 200  len: 809 time: 0.2387035
May 27 09:35:31.770722 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-1e404ad3-a675-48ed-9e52-5110200f67ce None None] Deleting port bae10c78-85a6-404c-bdbc-073e28e2353f {{(pid=91822) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:31.771272 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1e404ad3-a675-48ed-9e52-5110200f67ce None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:31.791772 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Request body: {'port': {'device_id': '0b21ab0b-67e3-44d8-9c93-a02606c79b96', 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86', 'admin_state_up': True, 'tenant_id': 'df5fdd9e30044571812bfe2cc2233af6'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:35:31.841256 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] For port bae10c78-85a6-404c-bdbc-073e28e2353f, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=bae10c78-85a6-404c-bdbc-073e28e2353f,segment=NetworkSegment(fb3bb56f-e851-4dc9-a059-75ed93004f61),segment_id=fb3bb56f-e851-4dc9-a059-75ed93004f61)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:31.841626 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:31.914782 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-1e404ad3-a675-48ed-9e52-5110200f67ce None None] For port bae10c78-85a6-404c-bdbc-073e28e2353f, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=bae10c78-85a6-404c-bdbc-073e28e2353f,segment=NetworkSegment(fb3bb56f-e851-4dc9-a059-75ed93004f61),segment_id=fb3bb56f-e851-4dc9-a059-75ed93004f61)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:31.915269 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1e404ad3-a675-48ed-9e52-5110200f67ce None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:31.978488 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Calling delete_port for bae10c78-85a6-404c-bdbc-073e28e2353f owned by network:dhcp {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:32.052791 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-1e404ad3-a675-48ed-9e52-5110200f67ce None None] Calling delete_port for bae10c78-85a6-404c-bdbc-073e28e2353f owned by network:dhcp {{(pid=91822) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:32.070871 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.079529 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e60d4224-5dbc-4362-94c0-da78612495d9 tempest-AttachVolumeNegativeTest-1111153693 tempest-AttachVolumeNegativeTest-1111153693-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:32.082867 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:32.092759 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.107428 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-dfea7dd5-20c4-4a69-bd82-2909657bb7a0 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:32.126158 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1e404ad3-a675-48ed-9e52-5110200f67ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116'] for port, after_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.131497 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:32.136915 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] No DVR routers for this DVR port bae10c78-85a6-404c-bdbc-073e28e2353f on host dv-cinder-772623-6-iscsi {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:35:32.160596 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:32.163037 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Pushing event deleted for resources: {'Port': ['ID=1eca5e85-1780-4a06-acb9-4adebee714f4,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:32.179115 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e404ad3-a675-48ed-9e52-5110200f67ce None None] Pushing event deleted for resources: {'Port': ['ID=bae10c78-85a6-404c-bdbc-073e28e2353f,revision_number=None']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:32.183675 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-1e404ad3-a675-48ed-9e52-5110200f67ce None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:32.185624 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Pushing event deleted for resources: {'Port': ['ID=bae10c78-85a6-404c-bdbc-073e28e2353f,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:32.186646 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e404ad3-a675-48ed-9e52-5110200f67ce None None] No DVR routers for this DVR port bae10c78-85a6-404c-bdbc-073e28e2353f on host dv-cinder-772623-6-iscsi {{(pid=91822) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:35:32.191826 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:32.212587 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:32.251929 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Made reservation on behalf of df5fdd9e30044571812bfe2cc2233af6 for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:35:32.255552 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.291827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.305836 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2eec3d7220>,) {'filters': {'network_id': ['93808fcf-da41-473a-b8e5-03797225e7ce']}} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:32.327007 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec3d7220>, 'fb3bb56f-e851-4dc9-a059-75ed93004f61') {'for_net_delete': True} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:32.327298 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec3d7220>, 'fb3bb56f-e851-4dc9-a059-75ed93004f61') {} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:32.340365 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2232170'] for segment, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.350720 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks [] for floatingip, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.367714 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.378564 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Releasing vlan 398 on physical network physnet1 to pool {{(pid=91821) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:35:32.378995 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2157387'] for segment, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]: Traceback (most recent call last):
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     timer()
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     cb(*args, **kw)
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     return func(*args, **kwargs)
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     self._notify()
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     self.callback(batched_events)
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     event.method(event)
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     return f(self, *a, **k)
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._get(url).json()
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self.request(url, 'GET', **kwargs)
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:35:32.392977 dv-cinder-772623-6-iscsi neutron-server[91821]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:35:32.404102 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.413167 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] 10.222.0.30 "DELETE /v2.0/floatingips/bd184371-ce98-4013-aa95-667c89febf8f HTTP/1.1" status: 204  len: 168 time: 1.7004559
May 27 09:35:32.473210 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device bae10c78-85a6-404c-bdbc-073e28e2353f no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:32.498410 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.505690 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Allocated IP 172.20.0.12 (435a0e3f-efcc-4b4f-9d00-e12d96978c86/11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f/da5a99d4-b6f1-4358-a64c-57d77281bd0d) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:35:32.510775 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.513863 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: bae10c78-85a6-404c-bdbc-073e28e2353f {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:32.514216 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device bae10c78-85a6-404c-bdbc-073e28e2353f not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:32.514641 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 810b9568-53a3-46b7-a25b-7d6c73eee345 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:32.523477 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-cbeb1949-3e02-449c-b733-6f55087e4060 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:32.550275 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 810b9568-53a3-46b7-a25b-7d6c73eee345 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:32.550631 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 810b9568-53a3-46b7-a25b-7d6c73eee345 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:32.572170 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] 10.222.0.30 "DELETE /v2.0/networks/93808fcf-da41-473a-b8e5-03797225e7ce HTTP/1.1" status: 204  len: 168 time: 1.2914784
May 27 09:35:32.575931 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Pushing event deleted for resources: {'Network': ['ID=93808fcf-da41-473a-b8e5-03797225e7ce,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:32.582685 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e1bbbb22-1293-4890-b36d-de14eadcd964 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:32.704006 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46538225-6888-4342-82e1-5fc32edd3b58 req-b0bd6547-82ae-43ad-b52b-5c6eb0a794e2 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 210 time: 0.0456851
May 27 09:35:32.798204 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56556) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:32.812399 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.850017 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:32.858993 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:32.900371 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-0aa38c37-13b8-43df-a072-a6ea26cb7cd8 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=a31154df1ce4420f9bdf53b8b3b3649e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0981076
May 27 09:35:32.900817 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56560) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:32.978389 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:35:32.981772 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:35:32.986433 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:35:32.996090 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-fcba37ef-f319-4dce-a0ad-1cb79370c693 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.015639 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Pushing event updated for resources: {'Port': ['ID=da5a99d4-b6f1-4358-a64c-57d77281bd0d,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:33.023845 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.164s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:33.026255 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-fcba37ef-f319-4dce-a0ad-1cb79370c693 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.052911 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:33.053585 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.080769 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-67f9c924-20e1-46cb-a466-9cabe47eb89e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.3001502
May 27 09:35:33.086276 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-fcba37ef-f319-4dce-a0ad-1cb79370c693 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.090745 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-c6784509-85dd-408e-a190-60fd93d057d8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:33.093480 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Request body: {'port': {'device_id': '0b21ab0b-67e3-44d8-9c93-a02606c79b96', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:35:33.102672 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcba37ef-f319-4dce-a0ad-1cb79370c693 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c51bd7a6-7968-4acc-acd8-342d1b7e9335,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:33.107661 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-fcba37ef-f319-4dce-a0ad-1cb79370c693 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:33.117159 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-fcba37ef-f319-4dce-a0ad-1cb79370c693 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.121191 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-fcba37ef-f319-4dce-a0ad-1cb79370c693 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/c51bd7a6-7968-4acc-acd8-342d1b7e9335 HTTP/1.1" status: 204  len: 168 time: 0.2157075
May 27 09:35:33.213659 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.517530 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56568) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:33.566869 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-b8c4ad8f-113e-46c6-b39e-34cc4f22ab8b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=8fa04a9552394b50b0cef7e35b83a87c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0480547
May 27 09:35:33.569330 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56572) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:33.630304 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5d0645d8-34f4-4b80-8630-1437e40135bb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.656591 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5d0645d8-34f4-4b80-8630-1437e40135bb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.691094 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id da5a99d4-b6f1-4358-a64c-57d77281bd0d {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:35:33.699177 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.716024 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5d0645d8-34f4-4b80-8630-1437e40135bb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.716280 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Transition to ACTIVE for port object da5a99d4-b6f1-4358-a64c-57d77281bd0d will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:35:33.719841 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.720247 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-be7fbe4d-e06f-4724-9253-7a3780f64f13 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:33.725709 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3f901fc7-448a-49d8-92b3-c0f220129967 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:33.844480 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d0645d8-34f4-4b80-8630-1437e40135bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d48c16a8-4840-462e-9f36-2e686d08026c,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:33.848752 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5d0645d8-34f4-4b80-8630-1437e40135bb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.129s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:33.852390 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5d0645d8-34f4-4b80-8630-1437e40135bb admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:33.853719 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-5d0645d8-34f4-4b80-8630-1437e40135bb admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/d48c16a8-4840-462e-9f36-2e686d08026c HTTP/1.1" status: 204  len: 168 time: 0.2834978
May 27 09:35:33.934452 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Pushing event updated for resources: {'Port': ['ID=da5a99d4-b6f1-4358-a64c-57d77281bd0d,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:33.938055 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:34.008623 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea37cefe-cddc-41a5-b4db-627c5792a389 req-a0205cf4-28bd-4ea0-9331-ac07dc92a090 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:34.016026 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ea37cefe-cddc-41a5-b4db-627c5792a389 req-a0205cf4-28bd-4ea0-9331-ac07dc92a090 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 944 time: 0.1202486
May 27 09:35:34.018865 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Attempting to bind port da5a99d4-b6f1-4358-a64c-57d77281bd0d on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:35:34.019210 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Attempting to bind port da5a99d4-b6f1-4358-a64c-57d77281bd0d by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '94a48d31-baf7-45c2-bce8-12ad5cc3d6a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:35:34.019588 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Attempting to bind port da5a99d4-b6f1-4358-a64c-57d77281bd0d on network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:35:34.026068 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Port da5a99d4-b6f1-4358-a64c-57d77281bd0d on network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:35:34.026400 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Attempting to bind port da5a99d4-b6f1-4358-a64c-57d77281bd0d on network 435a0e3f-efcc-4b4f-9d00-e12d96978c86 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:35:34.033438 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 35, 26), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:35:34.033781 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Checking segment: {'id': '94a48d31-baf7-45c2-bce8-12ad5cc3d6a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:35:34.034176 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Bound using segment: {'id': '94a48d31-baf7-45c2-bce8-12ad5cc3d6a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:35:34.034634 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Bound port: da5a99d4-b6f1-4358-a64c-57d77281bd0d, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '94a48d31-baf7-45c2-bce8-12ad5cc3d6a7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 384, 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:35:34.034989 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:34.081582 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ea37cefe-cddc-41a5-b4db-627c5792a389 req-8263c60b-1380-4b65-84bd-49563d5746c1 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0536163
May 27 09:35:34.105926 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:35:34.206279 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] For port da5a99d4-b6f1-4358-a64c-57d77281bd0d, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:35:34.212907 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] For port da5a99d4-b6f1-4358-a64c-57d77281bd0d, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=da5a99d4-b6f1-4358-a64c-57d77281bd0d,segment=NetworkSegment(94a48d31-baf7-45c2-bce8-12ad5cc3d6a7),segment_id=94a48d31-baf7-45c2-bce8-12ad5cc3d6a7)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:35:34.220789 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:34.235720 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-22810ef7-c51d-445f-a3bf-2cf8b2c0ae55 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:34.343062 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:34.343806 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:34.345188 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] 10.222.0.11 "PUT /v2.0/ports/da5a99d4-b6f1-4358-a64c-57d77281bd0d HTTP/1.1" status: 200  len: 1094 time: 1.2568529
May 27 09:35:34.345725 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0b21ab0b-67e3-44d8-9c93-a02606c79b96', 'tag': 'da5a99d4-b6f1-4358-a64c-57d77281bd0d'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:35:34.399846 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Pushing event updated for resources: {'Port': ['ID=da5a99d4-b6f1-4358-a64c-57d77281bd0d,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:34.404139 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.169s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:34.441460 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0b21ab0b-67e3-44d8-9c93-a02606c79b96', 'tag': 'da5a99d4-b6f1-4358-a64c-57d77281bd0d', 'status': 'completed', 'code': 200}
May 27 09:35:34.490533 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-57a1b874-835a-4c70-a7e1-6bbd55752a11 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:34.492024 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-57a1b874-835a-4c70-a7e1-6bbd55752a11 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=df5fdd9e30044571812bfe2cc2233af6&device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 1097 time: 0.0835779
May 27 09:35:34.565062 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-2d8239bf-db81-4de1-bc8a-b73986adc91d service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=da5a99d4-b6f1-4358-a64c-57d77281bd0d HTTP/1.1" status: 200  len: 217 time: 0.0660045
May 27 09:35:34.632348 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-0a7551c4-8450-4fca-9e3e-97a14db518b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:34.633818 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-0a7551c4-8450-4fca-9e3e-97a14db518b8 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f HTTP/1.1" status: 200  len: 849 time: 0.0619218
May 27 09:35:34.683840 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-57fbb3e0-3f00-4121-b70f-5831d279a134 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=435a0e3f-efcc-4b4f-9d00-e12d96978c86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0434332
May 27 09:35:34.825020 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-7d4e1c19-20e1-4481-98a2-6252e5e8ba85 service neutron] 10.222.0.11 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1354120
May 27 09:35:34.961809 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bfbcd80d-7eff-4778-a829-27f305c5706f req-1e174bda-7ae7-4f72-9e87-cf4a12f333f2 service neutron] 10.222.0.11 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1309338
May 27 09:35:35.083724 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf3ef38b-3f49-4fae-8846-652e21f53d23 req-8a802c55-ede8-4500-b18b-b3227a7494c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:35.085112 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bf3ef38b-3f49-4fae-8846-652e21f53d23 req-8a802c55-ede8-4500-b18b-b3227a7494c1 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=df5fdd9e30044571812bfe2cc2233af6&device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 1097 time: 0.0755606
May 27 09:35:35.240821 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf3ef38b-3f49-4fae-8846-652e21f53d23 req-c81ab3d7-7140-47d8-813f-31fa115d4c27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:35.242299 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bf3ef38b-3f49-4fae-8846-652e21f53d23 req-c81ab3d7-7140-47d8-813f-31fa115d4c27 service neutron] 10.222.0.11 "GET /v2.0/networks?id=435a0e3f-efcc-4b4f-9d00-e12d96978c86 HTTP/1.1" status: 200  len: 910 time: 0.1493053
May 27 09:35:35.313685 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bf3ef38b-3f49-4fae-8846-652e21f53d23 req-7754d136-2c9f-4fa1-b7c2-d285825c856e service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=da5a99d4-b6f1-4358-a64c-57d77281bd0d HTTP/1.1" status: 200  len: 217 time: 0.0639060
May 27 09:35:35.330527 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-533c72bd-fdb6-43ae-b5ee-d603d2a9a751 req-cab60de5-48dc-4c4c-afb9-01428e7c0e60 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:35.332455 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-533c72bd-fdb6-43ae-b5ee-d603d2a9a751 req-cab60de5-48dc-4c4c-afb9-01428e7c0e60 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 944 time: 0.1012754
May 27 09:35:35.412497 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-533c72bd-fdb6-43ae-b5ee-d603d2a9a751 req-9b42b841-4f8c-4b45-97c3-87903a57e6c1 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0683470
May 27 09:35:35.493968 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf3ef38b-3f49-4fae-8846-652e21f53d23 req-83ef2389-8d11-4126-87c7-05ae901747e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:35.496272 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bf3ef38b-3f49-4fae-8846-652e21f53d23 req-83ef2389-8d11-4126-87c7-05ae901747e7 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f HTTP/1.1" status: 200  len: 849 time: 0.1753004
May 27 09:35:35.547440 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bf3ef38b-3f49-4fae-8846-652e21f53d23 req-bd43a42b-7e8a-4582-88fe-535774e444d9 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=435a0e3f-efcc-4b4f-9d00-e12d96978c86&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 210 time: 0.0436709
May 27 09:35:35.549177 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56600) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:35.715564 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bf3ef38b-3f49-4fae-8846-652e21f53d23 req-623eaec1-8be9-42c4-a5f5-f07d6b345a3e service neutron] 10.222.0.11 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1591461
May 27 09:35:36.049075 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-bf3ef38b-3f49-4fae-8846-652e21f53d23 req-2c1c0ea9-f1ef-483b-a40a-e226e29a3c88 service neutron] 10.222.0.11 "GET /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.3258376
May 27 09:35:36.322452 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device da5a99d4-b6f1-4358-a64c-57d77281bd0d details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:35:36.463681 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port da5a99d4-b6f1-4358-a64c-57d77281bd0d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=da5a99d4-b6f1-4358-a64c-57d77281bd0d,segment=NetworkSegment(94a48d31-baf7-45c2-bce8-12ad5cc3d6a7),segment_id=94a48d31-baf7-45c2-bce8-12ad5cc3d6a7)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:36.475932 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3816697'] for router_interface, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:36.478789 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': 'da5a99d4-b6f1-4358-a64c-57d77281bd0d', 'network_id': '435a0e3f-efcc-4b4f-9d00-e12d96978c86', 'port_id': 'da5a99d4-b6f1-4358-a64c-57d77281bd0d', 'mac_address': 'fa:16:3e:28:20:00', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 384, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:35:36.541176 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:36.563052 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id da5a99d4-b6f1-4358-a64c-57d77281bd0d {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:35:36.581201 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port da5a99d4-b6f1-4358-a64c-57d77281bd0d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=da5a99d4-b6f1-4358-a64c-57d77281bd0d,segment=NetworkSegment(94a48d31-baf7-45c2-bce8-12ad5cc3d6a7),segment_id=94a48d31-baf7-45c2-bce8-12ad5cc3d6a7)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:36.585664 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:36.587667 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:36.637662 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72d49721-9583-4bc5-9e1a-cdb6983e462f req-64128992-b581-4c0f-a68d-bd4afbfe7407 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:36.639929 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72d49721-9583-4bc5-9e1a-cdb6983e462f req-64128992-b581-4c0f-a68d-bd4afbfe7407 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 944 time: 0.1015320
May 27 09:35:36.663221 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=da5a99d4-b6f1-4358-a64c-57d77281bd0d,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:36.666958 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:36.694889 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-72d49721-9583-4bc5-9e1a-cdb6983e462f req-e27e0f60-db95-4ec8-b1d7-1974c9b5b5ff tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0464971
May 27 09:35:36.785335 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['da5a99d4-b6f1-4358-a64c-57d77281bd0d'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:35:36.934490 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Deleting port 7515b299-be21-49ae-9c90-975237275947 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:36.934836 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:37.176415 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] For port 7515b299-be21-49ae-9c90-975237275947, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=7515b299-be21-49ae-9c90-975237275947,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:37.177179 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:37.310585 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Calling delete_port for 7515b299-be21-49ae-9c90-975237275947 owned by network:router_interface {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:37.476666 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:37.482141 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:37.529811 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Pushing event deleted for resources: {'Port': ['ID=7515b299-be21-49ae-9c90-975237275947,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:37.533008 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:37.841375 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3683824', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3812169'] for router_interface, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:37.905383 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-762f33d5-12c0-47f4-abcf-742a4ce67a6e req-68e88a91-87fb-44f1-98dc-38335cbf82b5 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:37.908596 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-762f33d5-12c0-47f4-abcf-742a4ce67a6e req-68e88a91-87fb-44f1-98dc-38335cbf82b5 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 945 time: 0.0923743
May 27 09:35:37.956887 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-762f33d5-12c0-47f4-abcf-742a4ce67a6e req-48f12c4f-f31c-4288-b38a-334db6c88d7f tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0435736
May 27 09:35:38.220977 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:35:38.347764 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device da5a99d4-b6f1-4358-a64c-57d77281bd0d up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:35:38.406986 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:35:38.418203 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d8c9789-7ed5-423a-893d-86793da31e99 None None] Sync routers for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:35:38.429487 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d8c9789-7ed5-423a-893d-86793da31e99 None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:35:38.430258 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-0d8c9789-7ed5-423a-893d-86793da31e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eedb3be80>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:38.430912 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] 10.222.0.30 "PUT /v2.0/routers/a7747f73-c1a4-4a6c-8c93-cf80d93a5583/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.8801351
May 27 09:35:38.432950 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56610) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:38.437604 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port da5a99d4-b6f1-4358-a64c-57d77281bd0d completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:35:38.442471 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port da5a99d4-b6f1-4358-a64c-57d77281bd0d triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:35:38.442856 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:38.517936 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-cb1579ab-89aa-4b48-bab3-f2a1b5c03867 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:38.624523 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:38.632360 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-0d8c9789-7ed5-423a-893d-86793da31e99 None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:35:38.666377 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0b21ab0b-67e3-44d8-9c93-a02606c79b96', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da5a99d4-b6f1-4358-a64c-57d77281bd0d'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:35:38.681815 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port da5a99d4-b6f1-4358-a64c-57d77281bd0d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=da5a99d4-b6f1-4358-a64c-57d77281bd0d,segment=NetworkSegment(94a48d31-baf7-45c2-bce8-12ad5cc3d6a7),segment_id=94a48d31-baf7-45c2-bce8-12ad5cc3d6a7)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:38.687570 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:38.691796 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:38.761633 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0b21ab0b-67e3-44d8-9c93-a02606c79b96', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'da5a99d4-b6f1-4358-a64c-57d77281bd0d', 'code': 200}
May 27 09:35:38.776999 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Notify callbacks [] for router, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:38.789335 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=da5a99d4-b6f1-4358-a64c-57d77281bd0d,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:38.800687 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:38.992222 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-0d8c9789-7ed5-423a-893d-86793da31e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eedb3be80>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242'}], 'enable_snat': True}, 'gw_port_id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:35:37Z', 'revision_number': 5, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port': {'id': '43ed4068-0876-4362-b9a6-c0cfd260601e', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:74:46:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'device_owner': 'network:router_gateway', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.242', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:27:08Z', 'updated_at': '2021-05-27T09:27:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:38.996649 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d8c9789-7ed5-423a-893d-86793da31e99 None None] Checking router: a7747f73-c1a4-4a6c-8c93-cf80d93a5583 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:35:39.006111 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d8c9789-7ed5-423a-893d-86793da31e99 None None] Routers {'a7747f73-c1a4-4a6c-8c93-cf80d93a5583'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:35:39.007298 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-0d8c9789-7ed5-423a-893d-86793da31e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eedb3be80>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:39.033907 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:39.081371 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dc83d39-9a9b-427e-ac9c-767fe1405785 req-5131abf9-3b11-4a60-be60-39cd13eec4b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:39.082883 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4dc83d39-9a9b-427e-ac9c-767fe1405785 req-5131abf9-3b11-4a60-be60-39cd13eec4b5 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 1099 time: 0.1320121
May 27 09:35:39.144115 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-4dc83d39-9a9b-427e-ac9c-767fe1405785 req-3b388f7f-2d5b-4d9a-8e1f-3d3c76d1a2c5 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0525935
May 27 09:35:39.157721 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Deleting port 43ed4068-0876-4362-b9a6-c0cfd260601e {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:39.158065 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:39.168618 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-0d8c9789-7ed5-423a-893d-86793da31e99 None None] Set router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 gateway port host: None {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:35:39.171908 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a6d52ee-dce0-4668-86c6-4ef6aafa57cb req-b25b8273-0825-4f7d-8b20-052d00744dad tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:39.173462 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8a6d52ee-dce0-4668-86c6-4ef6aafa57cb req-b25b8273-0825-4f7d-8b20-052d00744dad tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 946 time: 0.1007583
May 27 09:35:39.228503 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8a6d52ee-dce0-4668-86c6-4ef6aafa57cb req-1335c622-f0a3-406a-914c-244257f0d611 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0485697
May 27 09:35:39.277451 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-0d8c9789-7ed5-423a-893d-86793da31e99 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eedb3be80>, [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:35:39Z', 'revision_number': 6, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port_host': None}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:39.281731 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0d8c9789-7ed5-423a-893d-86793da31e99 None None] The sync data for ids ['a7747f73-c1a4-4a6c-8c93-cf80d93a5583'] in dv-cinder-772623-6-iscsi is: [{'id': 'a7747f73-c1a4-4a6c-8c93-cf80d93a5583', 'name': 'tempest-AttachVolumeShelveTestJSON-905086666-router', 'tenant_id': 'f631f0ceb250483891019fb79b2e6b83', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:27:05Z', 'updated_at': '2021-05-27T09:35:39Z', 'revision_number': 6, 'project_id': 'f631f0ceb250483891019fb79b2e6b83', 'gw_port_host': None}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:35:39.310225 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] For port 43ed4068-0876-4362-b9a6-c0cfd260601e, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=43ed4068-0876-4362-b9a6-c0cfd260601e,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:39.310696 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:39.442872 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Calling delete_port for 43ed4068-0876-4362-b9a6-c0cfd260601e owned by network:router_gateway {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:39.582259 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:39.586770 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e5acc13b-480b-4508-8175-87562bddd31a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:39.633395 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Pushing event deleted for resources: {'Port': ['ID=43ed4068-0876-4362-b9a6-c0cfd260601e,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:39.661298 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:39.732947 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3811286'] for router_gateway, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:39.912779 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3812681', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2009'] for router, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:39.915122 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:39.942036 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3812965'] for router, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:39.942586 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a7747f73-c1a4-4a6c-8c93-cf80d93a5583 {{(pid=91820) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 27 09:35:39.956142 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Notify callbacks [] for router, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:39.960559 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] 10.222.0.30 "DELETE /v2.0/routers/a7747f73-c1a4-4a6c-8c93-cf80d93a5583 HTTP/1.1" status: 204  len: 168 time: 1.5227835
May 27 09:35:39.960559 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56618) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:40.027248 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_v2 [None req-4b98c5a8-d610-464d-9521-b9e5bf091ec1 admin admin] Deleting subnet 77149737-85de-41af-b8e2-0509a46f467d {{(pid=91820) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:35:40.032008 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4b98c5a8-d610-464d-9521-b9e5bf091ec1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:40.086360 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4b98c5a8-d610-464d-9521-b9e5bf091ec1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3483778'] for subnet, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:40.211082 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4b98c5a8-d610-464d-9521-b9e5bf091ec1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:40.440147 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 7515b299-be21-49ae-9c90-975237275947 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:40.481164 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 7515b299-be21-49ae-9c90-975237275947 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:40.481807 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 7515b299-be21-49ae-9c90-975237275947 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:40.482242 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 43ed4068-0876-4362-b9a6-c0cfd260601e no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:40.497302 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7fef235-47a4-40f8-abb7-9d42dcf7d472 req-ea67ff44-cc15-4b73-9b76-9162e0bf7398 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:40.499057 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a7fef235-47a4-40f8-abb7-9d42dcf7d472 req-ea67ff44-cc15-4b73-9b76-9162e0bf7398 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 946 time: 0.0903561
May 27 09:35:40.518649 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 43ed4068-0876-4362-b9a6-c0cfd260601e {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:40.519010 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 43ed4068-0876-4362-b9a6-c0cfd260601e not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:40.565692 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a7fef235-47a4-40f8-abb7-9d42dcf7d472 req-14cf9178-2c29-4f3b-b6b8-38321f6ceb47 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0598619
May 27 09:35:40.673918 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4b98c5a8-d610-464d-9521-b9e5bf091ec1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2421409', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2490042'] for subnet, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:40.678826 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:40.750473 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b98c5a8-d610-464d-9521-b9e5bf091ec1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=77149737-85de-41af-b8e2-0509a46f467d,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:40.755168 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4b98c5a8-d610-464d-9521-b9e5bf091ec1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:40.756800 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4b98c5a8-d610-464d-9521-b9e5bf091ec1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:40.767826 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-4b98c5a8-d610-464d-9521-b9e5bf091ec1 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/77149737-85de-41af-b8e2-0509a46f467d HTTP/1.1" status: 204  len: 168 time: 0.8066304
May 27 09:35:40.769987 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56626) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:40.773531 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-48020f22-9365-49d8-971f-37d05e162647 None None] Network 624aa867-a71e-4343-8899-4e49257cd000 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:35:40.899756 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:40.998836 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Deleting port 437357ea-4e83-4e78-98c2-68e1309e808d {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:40.999254 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.086346 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4da57cf-335f-41f7-83b2-1cdf6d02cc73 None None] DHCP port deletion for 624aa867-a71e-4343-8899-4e49257cd000 request from dv-cinder-772623-6-iscsi {{(pid=91822) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 27 09:35:41.112396 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] For port 437357ea-4e83-4e78-98c2-68e1309e808d, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=437357ea-4e83-4e78-98c2-68e1309e808d,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:41.112936 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.154664 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-a4da57cf-335f-41f7-83b2-1cdf6d02cc73 None None] Deleting port 437357ea-4e83-4e78-98c2-68e1309e808d {{(pid=91822) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:41.155048 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a4da57cf-335f-41f7-83b2-1cdf6d02cc73 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.244762 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Calling delete_port for 437357ea-4e83-4e78-98c2-68e1309e808d owned by network:dhcp {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:41.253523 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-a4da57cf-335f-41f7-83b2-1cdf6d02cc73 None None] For port 437357ea-4e83-4e78-98c2-68e1309e808d, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=437357ea-4e83-4e78-98c2-68e1309e808d,segment=NetworkSegment(2a4e0452-89d7-4dda-9abd-65b3d289e707),segment_id=2a4e0452-89d7-4dda-9abd-65b3d289e707)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:41.253853 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a4da57cf-335f-41f7-83b2-1cdf6d02cc73 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.299818 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.304680 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-af1c6e44-e412-47fd-b72f-b9a144e58246 tempest-VolumesSnapshotTestJSON-1794675453 tempest-VolumesSnapshotTestJSON-1794675453-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:41.355936 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] No DVR routers for this DVR port 437357ea-4e83-4e78-98c2-68e1309e808d on host dv-cinder-772623-6-iscsi {{(pid=91820) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:35:41.382580 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-a4da57cf-335f-41f7-83b2-1cdf6d02cc73 None None] Calling delete_port for 437357ea-4e83-4e78-98c2-68e1309e808d owned by network:dhcp {{(pid=91822) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:41.385404 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Pushing event deleted for resources: {'Port': ['ID=437357ea-4e83-4e78-98c2-68e1309e808d,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:41.388431 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:41.426575 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a4da57cf-335f-41f7-83b2-1cdf6d02cc73 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116'] for port, after_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.430270 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-1b4a8061-8c17-4edb-b646-141a4d2b5da1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:41.480370 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4da57cf-335f-41f7-83b2-1cdf6d02cc73 None None] Pushing event deleted for resources: {'Port': ['ID=437357ea-4e83-4e78-98c2-68e1309e808d,revision_number=None']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:41.485381 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.487605 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-a4da57cf-335f-41f7-83b2-1cdf6d02cc73 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:41.491504 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a4da57cf-335f-41f7-83b2-1cdf6d02cc73 None None] No DVR routers for this DVR port 437357ea-4e83-4e78-98c2-68e1309e808d on host dv-cinder-772623-6-iscsi {{(pid=91822) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:35:41.498464 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.512420 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2eec8a0490>,) {'filters': {'network_id': ['624aa867-a71e-4343-8899-4e49257cd000']}} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:41.526502 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec8a0490>, '2a4e0452-89d7-4dda-9abd-65b3d289e707') {'for_net_delete': True} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:41.526811 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec8a0490>, '2a4e0452-89d7-4dda-9abd-65b3d289e707') {} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:41.538757 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3483835'] for segment, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.564408 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.573002 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Releasing vlan 396 on physical network physnet1 to pool {{(pid=91820) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:35:41.573424 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2421763'] for segment, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]: Traceback (most recent call last):
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     timer()
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     cb(*args, **kw)
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     return func(*args, **kwargs)
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     self._notify()
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     self.callback(batched_events)
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     event.method(event)
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     return f(self, *a, **k)
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._get(url).json()
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self.request(url, 'GET', **kwargs)
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:35:41.592736 dv-cinder-772623-6-iscsi neutron-server[91820]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:35:41.672767 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.677004 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-03e8fd8e-a14e-45ab-a984-17c4c9b8a0f0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:41.690653 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.702576 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Pushing event deleted for resources: {'Network': ['ID=624aa867-a71e-4343-8899-4e49257cd000,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:41.705815 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:41.717907 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-e29ce88b-99b6-495d-96f4-3d6a014ec6c2 admin admin] 10.222.0.30 "DELETE /v2.0/networks/624aa867-a71e-4343-8899-4e49257cd000 HTTP/1.1" status: 204  len: 168 time: 0.9468830
May 27 09:35:41.764977 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-128a57f4-7572-47d1-a82a-c878767ee2d3 req-9302f502-28dd-44c1-973b-4a9e9c9b63de tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:41.766382 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-128a57f4-7572-47d1-a82a-c878767ee2d3 req-9302f502-28dd-44c1-973b-4a9e9c9b63de tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 946 time: 0.1062148
May 27 09:35:41.817412 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-128a57f4-7572-47d1-a82a-c878767ee2d3 req-3819ec0a-213d-4c5a-a3f3-209760c2138c tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0445349
May 27 09:35:41.827562 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-66a26c17-db2c-4034-8401-a5250d20b5be None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:41.863150 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56644) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:41.914664 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-35ad6e0a-2fed-4e3b-aa90-0b8090a0f406 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=f631f0ceb250483891019fb79b2e6b83&name=default HTTP/1.1" status: 200  len: 2975 time: 0.0501184
May 27 09:35:41.917602 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56648) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:41.978192 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-36f40695-f318-4480-bf8a-9f50a269dd6f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:42.005962 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-36f40695-f318-4480-bf8a-9f50a269dd6f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:42.061600 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-36f40695-f318-4480-bf8a-9f50a269dd6f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:42.065318 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-888ec07c-270f-400c-a328-55858456d859 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:42.080912 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f40695-f318-4480-bf8a-9f50a269dd6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dead19a2-ed58-4c1b-b4be-9014768aadbd,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:42.084474 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-36f40695-f318-4480-bf8a-9f50a269dd6f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:42.090653 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-36f40695-f318-4480-bf8a-9f50a269dd6f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:42.091781 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-36f40695-f318-4480-bf8a-9f50a269dd6f admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/dead19a2-ed58-4c1b-b4be-9014768aadbd HTTP/1.1" status: 204  len: 168 time: 0.1729984
May 27 09:35:42.385427 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:42.428581 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 437357ea-4e83-4e78-98c2-68e1309e808d no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:42.464892 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 437357ea-4e83-4e78-98c2-68e1309e808d {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:42.465250 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 437357ea-4e83-4e78-98c2-68e1309e808d not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:43.015606 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-539e0e8c-668c-4ff7-af24-43a2a315de9e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:43.016417 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-539e0e8c-668c-4ff7-af24-43a2a315de9e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Synchronizing usage tracker for tenant:df5fdd9e30044571812bfe2cc2233af6 on resource:port {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:35:43.025732 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-125670ca-ddfe-4937-9aac-1075c8de1246 req-ac282826-fbe3-4a71-b493-65915b10d69e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:43.028635 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-125670ca-ddfe-4937-9aac-1075c8de1246 req-ac282826-fbe3-4a71-b493-65915b10d69e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 946 time: 0.0909445
May 27 09:35:43.038842 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-539e0e8c-668c-4ff7-af24-43a2a315de9e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Unset dirty status for tenant:df5fdd9e30044571812bfe2cc2233af6 on resource:port {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:35:43.040136 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-539e0e8c-668c-4ff7-af24-43a2a315de9e tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.11 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 946 time: 0.1189642
May 27 09:35:43.087986 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-125670ca-ddfe-4937-9aac-1075c8de1246 req-a2b84599-10d6-4eba-a78d-23ebae924fee tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/security-groups?id=a4f24706-1975-4704-b0ee-0a487db61b43&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0536249
May 27 09:35:43.204117 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Deleting port da5a99d4-b6f1-4358-a64c-57d77281bd0d {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:35:43.204446 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:43.353914 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] For port da5a99d4-b6f1-4358-a64c-57d77281bd0d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=da5a99d4-b6f1-4358-a64c-57d77281bd0d,segment=NetworkSegment(94a48d31-baf7-45c2-bce8-12ad5cc3d6a7),segment_id=94a48d31-baf7-45c2-bce8-12ad5cc3d6a7)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:35:43.354307 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:43.483964 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Calling delete_port for da5a99d4-b6f1-4358-a64c-57d77281bd0d owned by compute:nova {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:35:43.602639 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:43.608841 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:43.617804 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['da5a99d4-b6f1-4358-a64c-57d77281bd0d'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:35:43.659646 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56702) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:43.662197 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Pushing event deleted for resources: {'Port': ['ID=da5a99d4-b6f1-4358-a64c-57d77281bd0d,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:43.699499 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:43.748026 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] No DVR routers for this DVR port da5a99d4-b6f1-4358-a64c-57d77281bd0d on host hv-cinder-77262 {{(pid=91820) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:35:43.750481 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:43.753192 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0b21ab0b-67e3-44d8-9c93-a02606c79b96', 'name': 'network-vif-deleted', 'tag': 'da5a99d4-b6f1-4358-a64c-57d77281bd0d'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:35:43.769395 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ca6ffec4-e71f-4570-b796-955f6c46ccfc req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.11 "DELETE /v2.0/ports/da5a99d4-b6f1-4358-a64c-57d77281bd0d HTTP/1.1" status: 204  len: 173 time: 0.7236924
May 27 09:35:43.804612 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0b21ab0b-67e3-44d8-9c93-a02606c79b96', 'name': 'network-vif-deleted', 'tag': 'da5a99d4-b6f1-4358-a64c-57d77281bd0d', 'status': 'completed', 'code': 200}
May 27 09:35:43.831412 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b64a251b-a5d2-470e-a80d-e37904f5311b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:43.943977 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-b64a251b-a5d2-470e-a80d-e37904f5311b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:43.947816 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-b64a251b-a5d2-470e-a80d-e37904f5311b admin admin] Usage tracker for resource:security_group_rule and tenant:ea71e3969c2747218c77c4a364b210af is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:43.951540 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-b64a251b-a5d2-470e-a80d-e37904f5311b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:43.958704 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-b64a251b-a5d2-470e-a80d-e37904f5311b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:44.049725 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b64a251b-a5d2-470e-a80d-e37904f5311b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:44.053589 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-b64a251b-a5d2-470e-a80d-e37904f5311b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:44.063021 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-144ab70a-9d20-4180-88e8-9f932a5979c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:44.101851 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-b64a251b-a5d2-470e-a80d-e37904f5311b admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=ea71e3969c2747218c77c4a364b210af&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4410274
May 27 09:35:44.103598 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b64a251b-a5d2-470e-a80d-e37904f5311b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=193598d0-b1e7-4bdd-84f0-270df749e250,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:44.104601 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56710) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:44.106889 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b64a251b-a5d2-470e-a80d-e37904f5311b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:44.164945 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-406f6cb6-44de-4c30-a0e7-ca9d626818e2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:44.192168 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-406f6cb6-44de-4c30-a0e7-ca9d626818e2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:44.278813 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-314acfba-9f46-407a-870b-01dd77e0cf6e req-eac05769-d29c-4307-9e7c-342e4839c4a4 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] 10.222.0.30 "GET /v2.0/ports?device_id=0b21ab0b-67e3-44d8-9c93-a02606c79b96 HTTP/1.1" status: 200  len: 210 time: 0.0590737
May 27 09:35:44.297795 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-406f6cb6-44de-4c30-a0e7-ca9d626818e2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:44.303810 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7dccdb5a-5dae-4d3c-99af-26f6a05626b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:44.316705 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-406f6cb6-44de-4c30-a0e7-ca9d626818e2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=193598d0-b1e7-4bdd-84f0-270df749e250,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:44.319302 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-406f6cb6-44de-4c30-a0e7-ca9d626818e2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:44.320728 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-406f6cb6-44de-4c30-a0e7-ca9d626818e2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:44.325534 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-406f6cb6-44de-4c30-a0e7-ca9d626818e2 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/193598d0-b1e7-4bdd-84f0-270df749e250 HTTP/1.1" status: 204  len: 168 time: 0.2162817
May 27 09:35:44.933110 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:45.056467 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 56736) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:45.165632 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-828094187-network', 'tenant_id': '304d93a123e64f56a1dfbfe88fc342f3'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:35:45.170959 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:45.174833 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Usage tracker for resource:network and tenant:304d93a123e64f56a1dfbfe88fc342f3 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:45.177956 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:45.185087 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:45.194255 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Made reservation on behalf of 304d93a123e64f56a1dfbfe88fc342f3 for: {'network': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:35:45.196861 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:45.209558 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:45.224876 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:45.228663 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Usage tracker for resource:security_group_rule and tenant:304d93a123e64f56a1dfbfe88fc342f3 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:45.231927 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:45.237650 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:45.325841 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:45.330008 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:45.333289 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dfef8719-d454-4e4f-a460-0a28bcf7ea7d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:45.363253 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] vlan segment allocate from pool success with {'vlan_id': 396, 'physical_network': 'physnet1'}  {{(pid=91821) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:35:45.373753 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=95f48191-1512-47a0-b39f-537320f20f33,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:45.377322 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:45.383728 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:45.383981 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.segments_db [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Added segment 3bf4a1fc-8182-4b06-91e0-8b720291423f of type vlan for network 43cffb57-b893-428c-a5f5-cf09a19fcb60
May 27 09:35:45.412774 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:45.444815 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:45.446955 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:45.447718 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:45.456211 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:45.563074 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 897 time: 0.5054598
May 27 09:35:45.565908 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Pushing event updated for resources: {'Network': ['ID=43cffb57-b893-428c-a5f5-cf09a19fcb60,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:45.568667 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56750) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:45.573749 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5da8ad45-b332-45a7-bb23-4c97cc897a6c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:45.581184 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Request body: {'subnet': {'network_id': '43cffb57-b893-428c-a5f5-cf09a19fcb60', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-828094187-subnet', 'tenant_id': '304d93a123e64f56a1dfbfe88fc342f3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:35:45.587079 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 43cffb57-b893-428c-a5f5-cf09a19fcb60 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:35:45.587720 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:45.592462 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Usage tracker for resource:subnet and tenant:304d93a123e64f56a1dfbfe88fc342f3 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:45.595493 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:45.604461 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:45.632128 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Made reservation on behalf of 304d93a123e64f56a1dfbfe88fc342f3 for: {'subnet': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:35:45.636318 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2490007'] for subnet, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:46.120859 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2421472', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2489985'] for subnet, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:46.126225 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-86d91eaa-c989-40e2-879d-452199e36274 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:46.210805 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=06c17bf7-7fd8-4a66-806d-86f1bae8a966,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:46.215597 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:46.218837 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Checking segment: {'id': '3bf4a1fc-8182-4b06-91e0-8b720291423f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 396, 'network_id': '43cffb57-b893-428c-a5f5-cf09a19fcb60'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:35:46.219394 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Network hostable DHCP agents. Network: 43cffb57-b893-428c-a5f5-cf09a19fcb60, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91820) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:35:46.241185 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Network 43cffb57-b893-428c-a5f5-cf09a19fcb60 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91820) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:35:46.251147 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 43cffb57-b893-428c-a5f5-cf09a19fcb60) {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:35:46.261295 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03d9ad75-4ff0-4dc4-b7e1-704221333bab None None] Network 43cffb57-b893-428c-a5f5-cf09a19fcb60 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:35:46.262712 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:46.263347 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:46.303400 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-a720ab6c-aa62-4898-9e51-7d7e1b3368c0 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 861 time: 0.7202406
May 27 09:35:46.388053 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device da5a99d4-b6f1-4358-a64c-57d77281bd0d no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:35:46.430171 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: da5a99d4-b6f1-4358-a64c-57d77281bd0d {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:35:46.430555 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device da5a99d4-b6f1-4358-a64c-57d77281bd0d not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:35:46.521200 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2310aacb-9813-43d1-b54b-488439b33996 None None] Network 43cffb57-b893-428c-a5f5-cf09a19fcb60 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:35:46.875460 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56804) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:46.881448 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1196838720-network', 'tenant_id': 'c43e588b96a849dab6a7c07f789d97b9'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:35:46.887249 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:46.891594 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Usage tracker for resource:network and tenant:c43e588b96a849dab6a7c07f789d97b9 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:46.895266 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:46.902828 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:46.918323 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Made reservation on behalf of c43e588b96a849dab6a7c07f789d97b9 for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:35:46.920719 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:46.933326 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:46.950109 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:46.954218 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Usage tracker for resource:security_group_rule and tenant:c43e588b96a849dab6a7c07f789d97b9 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:46.957164 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:46.963180 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:47.070660 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:47.075895 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:47.080712 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d38e4e5b-24e8-4937-9e1d-c8e7fa1b2b52 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:47.112866 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] vlan segment allocate from pool success with {'vlan_id': 366, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:35:47.122155 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4932371f-b051-48b8-a412-09e42e4cec81,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:47.125797 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:47.128692 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:47.129026 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Added segment d0d43ecf-2ffe-4560-bbea-ec8d2dbbe980 of type vlan for network 891b00f7-9c2b-4f18-ae23-37111451bccb
May 27 09:35:47.159600 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:47.190455 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:47.191843 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:47.192445 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:47.196269 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:47.302542 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Pushing event updated for resources: {'Network': ['ID=891b00f7-9c2b-4f18-ae23-37111451bccb,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:47.305589 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 898 time: 0.4290543
May 27 09:35:47.306502 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1ff22da9-6887-474e-ad31-b5e5a5fc0a47 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:47.309421 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56808) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:47.314197 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 891b00f7-9c2b-4f18-ae23-37111451bccb details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:35:47.315276 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Request body: {'subnet': {'network_id': '891b00f7-9c2b-4f18-ae23-37111451bccb', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1196838720-subnet', 'tenant_id': 'c43e588b96a849dab6a7c07f789d97b9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:35:47.320835 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:47.325838 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Usage tracker for resource:subnet and tenant:c43e588b96a849dab6a7c07f789d97b9 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:47.329068 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:47.336505 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:47.349119 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Made reservation on behalf of c43e588b96a849dab6a7c07f789d97b9 for: {'subnet': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:35:47.352222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2490007'] for subnet, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:47.827839 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2421472', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2489985'] for subnet, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:47.832046 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:47.905483 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d7f24f8f-5b42-4f49-9b8b-d0d324f2a9c3,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:47.909511 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:47.917514 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Checking segment: {'id': 'd0d43ecf-2ffe-4560-bbea-ec8d2dbbe980', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 366, 'network_id': '891b00f7-9c2b-4f18-ae23-37111451bccb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:35:47.917886 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Network hostable DHCP agents. Network: 891b00f7-9c2b-4f18-ae23-37111451bccb, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91820) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:35:47.936419 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Network 891b00f7-9c2b-4f18-ae23-37111451bccb is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91820) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:35:47.950000 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 891b00f7-9c2b-4f18-ae23-37111451bccb) {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:35:47.959627 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe5a0ec4-c7c8-4876-a791-90cb8f804c96 None None] Network 891b00f7-9c2b-4f18-ae23-37111451bccb requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:35:47.961067 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:35:47.961685 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:47.986676 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-7763c4eb-307c-4325-9ba6-90060ecbace9 admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 862 time: 0.6758738
May 27 09:35:48.145172 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56818) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:48.196266 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-574422aa-ac33-4752-b344-1bcb1f6e73d2 None None] Network 891b00f7-9c2b-4f18-ae23-37111451bccb requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:35:48.228933 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_v2 [None req-9b06611b-e3bf-40f9-b45a-10570f691333 admin admin] Deleting subnet 06c17bf7-7fd8-4a66-806d-86f1bae8a966 {{(pid=91820) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:35:48.234250 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-9b06611b-e3bf-40f9-b45a-10570f691333 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:48.286991 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-9b06611b-e3bf-40f9-b45a-10570f691333 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3483778'] for subnet, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:48.348146 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-9b06611b-e3bf-40f9-b45a-10570f691333 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:48.710304 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-9b06611b-e3bf-40f9-b45a-10570f691333 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2421409', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2490042'] for subnet, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:48.715031 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:48.752126 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b06611b-e3bf-40f9-b45a-10570f691333 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=06c17bf7-7fd8-4a66-806d-86f1bae8a966,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:48.754106 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-9b06611b-e3bf-40f9-b45a-10570f691333 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:48.756822 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-9b06611b-e3bf-40f9-b45a-10570f691333 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:48.761717 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-9b06611b-e3bf-40f9-b45a-10570f691333 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/06c17bf7-7fd8-4a66-806d-86f1bae8a966 HTTP/1.1" status: 204  len: 168 time: 0.6146996
May 27 09:35:48.764461 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56822) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:48.893404 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.024867 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.038298 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2eecce6400>,) {'filters': {'network_id': ['43cffb57-b893-428c-a5f5-cf09a19fcb60']}} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:49.051231 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eecce6400>, '3bf4a1fc-8182-4b06-91e0-8b720291423f') {'for_net_delete': True} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:49.051559 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eecce6400>, '3bf4a1fc-8182-4b06-91e0-8b720291423f') {} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:49.063518 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3483835'] for segment, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.079613 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.085892 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] Releasing vlan 396 on physical network physnet1 to pool {{(pid=91820) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:35:49.086270 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2421763'] for segment, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]: Traceback (most recent call last):
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     timer()
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     cb(*args, **kw)
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     return func(*args, **kwargs)
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     self._notify()
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     self.callback(batched_events)
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     event.method(event)
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     return f(self, *a, **k)
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._get(url).json()
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self.request(url, 'GET', **kwargs)
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:35:49.099649 dv-cinder-772623-6-iscsi neutron-server[91820]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:35:49.181080 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.185578 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-909d6498-698a-4e65-85b2-dd3846515222 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:49.198671 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.208285 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] Pushing event deleted for resources: {'Network': ['ID=43cffb57-b893-428c-a5f5-cf09a19fcb60,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:49.210772 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] 10.222.0.30 "DELETE /v2.0/networks/43cffb57-b893-428c-a5f5-cf09a19fcb60 HTTP/1.1" status: 204  len: 168 time: 0.4449797
May 27 09:35:49.211733 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e35c91f1-97fb-4a23-a01e-3ef402e0aa00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:49.213484 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56830) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:49.273519 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_v2 [None req-1655a910-3898-42d5-b63b-14caaab71b02 admin admin] Deleting subnet d7f24f8f-5b42-4f49-9b8b-d0d324f2a9c3 {{(pid=91820) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:35:49.277238 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1655a910-3898-42d5-b63b-14caaab71b02 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.330510 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1655a910-3898-42d5-b63b-14caaab71b02 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3483778'] for subnet, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.387324 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1655a910-3898-42d5-b63b-14caaab71b02 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.648599 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1655a910-3898-42d5-b63b-14caaab71b02 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2421409', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2490042'] for subnet, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.653829 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-cbe018ca-f3c8-4703-a31f-2087d808ffae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:49.689780 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1655a910-3898-42d5-b63b-14caaab71b02 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d7f24f8f-5b42-4f49-9b8b-d0d324f2a9c3,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:49.692875 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1655a910-3898-42d5-b63b-14caaab71b02 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:49.693863 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1655a910-3898-42d5-b63b-14caaab71b02 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.701030 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-1655a910-3898-42d5-b63b-14caaab71b02 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/d7f24f8f-5b42-4f49-9b8b-d0d324f2a9c3 HTTP/1.1" status: 204  len: 168 time: 0.4858739
May 27 09:35:49.703552 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56834) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:49.816305 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.945841 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:49.959697 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2ee7f67760>,) {'filters': {'network_id': ['891b00f7-9c2b-4f18-ae23-37111451bccb']}} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:49.973332 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee7f67760>, 'd0d43ecf-2ffe-4560-bbea-ec8d2dbbe980') {'for_net_delete': True} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:49.973635 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee7f67760>, 'd0d43ecf-2ffe-4560-bbea-ec8d2dbbe980') {} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:35:49.985862 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3483835'] for segment, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:50.002507 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:50.008676 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] Releasing vlan 366 on physical network physnet1 to pool {{(pid=91820) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:35:50.009064 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2421763'] for segment, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]: Traceback (most recent call last):
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     timer()
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     cb(*args, **kw)
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     return func(*args, **kwargs)
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     self._notify()
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     self.callback(batched_events)
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     event.method(event)
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     return f(self, *a, **k)
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._get(url).json()
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self.request(url, 'GET', **kwargs)
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:35:50.022871 dv-cinder-772623-6-iscsi neutron-server[91820]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:35:50.102148 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:50.109679 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:50.112325 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-caab3ed3-1e2d-4e5d-bb12-e6fe601f4bee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:50.133625 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] 10.222.0.30 "DELETE /v2.0/networks/891b00f7-9c2b-4f18-ae23-37111451bccb HTTP/1.1" status: 204  len: 168 time: 0.4290717
May 27 09:35:50.134550 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] Pushing event deleted for resources: {'Network': ['ID=891b00f7-9c2b-4f18-ae23-37111451bccb,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:50.138525 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f0ddccb7-9e70-4894-9304-edcd3fa7dc08 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:50.318043 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56844) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:50.369487 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-e2aad24f-f5fe-4667-9f66-a768065bbbd0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=304d93a123e64f56a1dfbfe88fc342f3&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0501962
May 27 09:35:50.372752 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56848) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:50.460522 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-04647a03-76ca-4a5c-aff6-84874b46d6e7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:50.595050 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-04647a03-76ca-4a5c-aff6-84874b46d6e7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:50.657158 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-04647a03-76ca-4a5c-aff6-84874b46d6e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:50.662333 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-146cabc6-e3ef-4bf2-888b-bf10ea024270 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:50.674497 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04647a03-76ca-4a5c-aff6-84874b46d6e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95f48191-1512-47a0-b39f-537320f20f33,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:50.679502 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-04647a03-76ca-4a5c-aff6-84874b46d6e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:50.681454 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-04647a03-76ca-4a5c-aff6-84874b46d6e7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:50.683287 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-04647a03-76ca-4a5c-aff6-84874b46d6e7 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/95f48191-1512-47a0-b39f-537320f20f33 HTTP/1.1" status: 204  len: 168 time: 0.3088946
May 27 09:35:51.212278 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56874) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:51.270619 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-366f5a23-5218-40db-a7ab-dc0aa32d0878 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=c43e588b96a849dab6a7c07f789d97b9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0568516
May 27 09:35:51.273046 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 56878) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:51.353161 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3a9ff2b5-84a7-406f-9223-7c1d7695f011 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:51.388641 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3a9ff2b5-84a7-406f-9223-7c1d7695f011 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:51.460949 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3a9ff2b5-84a7-406f-9223-7c1d7695f011 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:51.471024 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2e33ab3d-8714-40d4-a7c3-6290c40f1e70 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:51.497425 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a9ff2b5-84a7-406f-9223-7c1d7695f011 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4932371f-b051-48b8-a412-09e42e4cec81,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:51.500334 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3a9ff2b5-84a7-406f-9223-7c1d7695f011 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:51.501828 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3a9ff2b5-84a7-406f-9223-7c1d7695f011 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:51.506635 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-3a9ff2b5-84a7-406f-9223-7c1d7695f011 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/4932371f-b051-48b8-a412-09e42e4cec81 HTTP/1.1" status: 204  len: 168 time: 0.2292202
May 27 09:35:56.463453 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:59.541655 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57006) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:59.687448 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ef616537-c28d-4e26-9cbc-a9520b424c06 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:59.704885 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-ef616537-c28d-4e26-9cbc-a9520b424c06 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:35:59.710006 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-ef616537-c28d-4e26-9cbc-a9520b424c06 admin admin] Usage tracker for resource:security_group_rule and tenant:844aee19612a407dafafd4b7c70fb61e is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:35:59.713459 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-ef616537-c28d-4e26-9cbc-a9520b424c06 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:35:59.720037 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-ef616537-c28d-4e26-9cbc-a9520b424c06 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:35:59.823109 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ef616537-c28d-4e26-9cbc-a9520b424c06 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:59.828964 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-ef616537-c28d-4e26-9cbc-a9520b424c06 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:59.852577 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-179fbe23-14f4-44f4-8871-9dcca95d0505 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:35:59.865589 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-ef616537-c28d-4e26-9cbc-a9520b424c06 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=844aee19612a407dafafd4b7c70fb61e&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3220816
May 27 09:35:59.868376 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57012) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:35:59.888637 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef616537-c28d-4e26-9cbc-a9520b424c06 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd8610da-d780-4e2e-a716-614e3c8dc98f,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:35:59.892591 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ef616537-c28d-4e26-9cbc-a9520b424c06 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:35:59.948514 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:35:59.983972 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:00.058745 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:00.066146 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7e5907f1-0d3a-4262-ba6b-630254f86ee1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:00.081936 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd8610da-d780-4e2e-a716-614e3c8dc98f,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:00.083414 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:00.086911 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/dd8610da-d780-4e2e-a716-614e3c8dc98f HTTP/1.1" status: 204  len: 168 time: 0.2174301
May 27 09:36:00.094193 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.094723 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.095196 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.095567 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.096017 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.096722 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.097144 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.097576 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.098027 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.098458 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.099151 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.099611 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:00.104999 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:00.538700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57024) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:00.559969 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-383ab418-8f4c-4075-a423-0d39bd30f828 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:00.577638 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-383ab418-8f4c-4075-a423-0d39bd30f828 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:36:00.582339 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-383ab418-8f4c-4075-a423-0d39bd30f828 admin admin] Usage tracker for resource:security_group_rule and tenant:6ee05780d759494784bbf068b9cc39d9 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:36:00.585716 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-383ab418-8f4c-4075-a423-0d39bd30f828 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:36:00.593644 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-383ab418-8f4c-4075-a423-0d39bd30f828 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:36:00.722195 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-383ab418-8f4c-4075-a423-0d39bd30f828 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:00.728214 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-383ab418-8f4c-4075-a423-0d39bd30f828 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:00.752656 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-04647a03-76ca-4a5c-aff6-84874b46d6e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:00.812174 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-383ab418-8f4c-4075-a423-0d39bd30f828 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6ee05780d759494784bbf068b9cc39d9&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2713630
May 27 09:36:00.813603 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57028) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:00.835071 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-383ab418-8f4c-4075-a423-0d39bd30f828 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ce38597-3e7f-4977-ad08-b9af1cad3379,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:00.844724 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-383ab418-8f4c-4075-a423-0d39bd30f828 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:00.909819 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3c6d544-23b2-4ddb-8b19-03c145172afe admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:00.945093 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3c6d544-23b2-4ddb-8b19-03c145172afe admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:01.013239 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3c6d544-23b2-4ddb-8b19-03c145172afe admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:01.023008 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-bac418fb-9cf6-416a-a0f7-d243204eac5d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:01.039880 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c6d544-23b2-4ddb-8b19-03c145172afe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ce38597-3e7f-4977-ad08-b9af1cad3379,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:01.044518 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a3c6d544-23b2-4ddb-8b19-03c145172afe admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:01.045831 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-a3c6d544-23b2-4ddb-8b19-03c145172afe admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:01.046986 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-a3c6d544-23b2-4ddb-8b19-03c145172afe admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/3ce38597-3e7f-4977-ad08-b9af1cad3379 HTTP/1.1" status: 204  len: 168 time: 0.2288263
May 27 09:36:03.131005 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd462cb-6621-4ae4-9de0-e450c2d5be08 req-9ef54a00-1679-4bc8-bb33-8a263dcfdffe tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:03.133319 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1cd462cb-6621-4ae4-9de0-e450c2d5be08 req-9ef54a00-1679-4bc8-bb33-8a263dcfdffe tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 946 time: 0.1075461
May 27 09:36:03.201972 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1cd462cb-6621-4ae4-9de0-e450c2d5be08 req-fc6efb89-ef2a-4a1f-8f61-1d2bf850f8af tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0602012
May 27 09:36:04.519291 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7d49973-749b-415c-aec4-5edd930a081b req-2c7fe9e7-309c-4b7d-9bfd-b51ab337d53d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:04.520773 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f7d49973-749b-415c-aec4-5edd930a081b req-2c7fe9e7-309c-4b7d-9bfd-b51ab337d53d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 946 time: 0.1101141
May 27 09:36:04.579943 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f7d49973-749b-415c-aec4-5edd930a081b req-464ab399-0bc4-4dba-96e9-a6eb4d349201 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0523691
May 27 09:36:04.722867 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-010ed030-2ec8-416b-ad88-2d9134639959 req-273884ec-e4a7-44f5-b873-2557a7995f22 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:04.723809 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-010ed030-2ec8-416b-ad88-2d9134639959 req-273884ec-e4a7-44f5-b873-2557a7995f22 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Synchronizing usage tracker for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:36:04.742694 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-010ed030-2ec8-416b-ad88-2d9134639959 req-273884ec-e4a7-44f5-b873-2557a7995f22 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Unset dirty status for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:36:04.744406 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-010ed030-2ec8-416b-ad88-2d9134639959 req-273884ec-e4a7-44f5-b873-2557a7995f22 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 946 time: 0.1131263
May 27 09:36:04.923545 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Deleting port 9734bd01-bec4-4629-a99e-36b3d4950146 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:36:04.923893 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:05.087509 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] For port 9734bd01-bec4-4629-a99e-36b3d4950146, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=9734bd01-bec4-4629-a99e-36b3d4950146,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:36:05.087875 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:05.522012 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:05.522884 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:05.523206 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.l3_db [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Floating IP fc0f0f43-cc17-42cb-a998-b0842de1fdeb disassociated. External IP: 172.27.1.119, port: 9734bd01-bec4-4629-a99e-36b3d4950146.
May 27 09:36:05.523613 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Calling delete_port for 9734bd01-bec4-4629-a99e-36b3d4950146 owned by compute:nova {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:36:05.677209 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:05.686483 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d6ae6be2-9013-427a-a57b-c0de2417923d service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:05.762540 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event deleted for resources: {'Port': ['ID=9734bd01-bec4-4629-a99e-36b3d4950146,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:05.773392 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-15625a70-2c94-4684-950d-5db69f20c3b2 req-df0103f7-ec7f-4f86-bf7b-7365fb1e8a01 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 210 time: 0.0629382
May 27 09:36:05.784003 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:05.995744 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:36:06.297614 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:36:06.307441 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9396fdcb-bb1e-4455-8696-e70308db8483 None None] Sync routers for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:36:06.316772 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9396fdcb-bb1e-4455-8696-e70308db8483 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:36:06.318078 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-9396fdcb-bb1e-4455-8696-e70308db8483 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eedad09a0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:36:06.371334 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] No DVR routers for this DVR port 9734bd01-bec4-4629-a99e-36b3d4950146 on host hv-cinder-77262 {{(pid=91820) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:36:06.375077 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:06.377843 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '833aa915-b338-444b-b501-e9dac73b7858', 'name': 'network-vif-deleted', 'tag': '9734bd01-bec4-4629-a99e-36b3d4950146'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:36:06.396201 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-010ed030-2ec8-416b-ad88-2d9134639959 req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "DELETE /v2.0/ports/9734bd01-bec4-4629-a99e-36b3d4950146 HTTP/1.1" status: 204  len: 173 time: 1.6458135
May 27 09:36:06.429169 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '833aa915-b338-444b-b501-e9dac73b7858', 'name': 'network-vif-deleted', 'tag': '9734bd01-bec4-4629-a99e-36b3d4950146', 'status': 'completed', 'code': 200}
May 27 09:36:06.508574 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-9396fdcb-bb1e-4455-8696-e70308db8483 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:36:06.858415 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-9396fdcb-bb1e-4455-8696-e70308db8483 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eedad09a0>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:36:06.863912 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9396fdcb-bb1e-4455-8696-e70308db8483 None None] Checking router: 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:36:06.874942 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9396fdcb-bb1e-4455-8696-e70308db8483 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:36:06.876302 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-9396fdcb-bb1e-4455-8696-e70308db8483 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eedad09a0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:35:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:36:06.981276 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-df4c240c-34f5-4a7f-b947-18a01b045ed6 req-eb34c461-68e5-419d-8a44-278d9926eb9c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 210 time: 0.0457289
May 27 09:36:07.118512 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-9396fdcb-bb1e-4455-8696-e70308db8483 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:36:07.430739 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-9396fdcb-bb1e-4455-8696-e70308db8483 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eedad09a0>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:36:07.435307 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9396fdcb-bb1e-4455-8696-e70308db8483 None None] The sync data for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi is: [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:36:07.635417 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8b6c15a-af13-42e6-998d-a82b78af4de5 None None] New status for floating IP fc0f0f43-cc17-42cb-a998-b0842de1fdeb: DOWN {{(pid=91823) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:36:08.131760 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9759fed5-baf4-4f62-86e9-854ab7d0767a req-37120a0d-6c44-4f5c-90d2-ece0e8679639 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 210 time: 0.0440481
May 27 09:36:08.512134 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-8e498f35-abaa-4fbe-9c8c-128908dc15a4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:09.375789 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-132fd235-2b94-4aab-a9f7-1a82541834fc req-6ab5c8ee-ae4e-4276-ac6f-302dc7d8b537 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=833aa915-b338-444b-b501-e9dac73b7858 HTTP/1.1" status: 200  len: 210 time: 0.1359563
May 27 09:36:09.728554 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9734bd01-bec4-4629-a99e-36b3d4950146 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:36:09.782573 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 9734bd01-bec4-4629-a99e-36b3d4950146 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:36:09.782938 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 9734bd01-bec4-4629-a99e-36b3d4950146 not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:36:10.862930 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-236e838a-6897-4a2e-aa17-364f34f77c8f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1951300864&fields=id&tenant_id=b8df97a650014930beb6e52081be8e90 HTTP/1.1" status: 200  len: 267 time: 0.0492842
May 27 09:36:11.052975 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-656445cc-21c3-421c-b48b-84101145505f req-501e70be-f9c4-48ae-afd1-1997ec4d621f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:11.054432 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-501e70be-f9c4-48ae-afd1-1997ec4d621f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 811 time: 0.1785765
May 27 09:36:11.076480 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-b4d5161a-3ba1-4642-bb52-0ff8380d5213 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/quotas/b8df97a650014930beb6e52081be8e90 HTTP/1.1" status: 200  len: 375 time: 0.0106955
May 27 09:36:11.106388 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:36:11.179494 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-8366502c-c461-484b-9828-936f8038fe34 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&fields=id HTTP/1.1" status: 200  len: 348 time: 0.0927546
May 27 09:36:11.348974 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-b8fcd1a4-fb14-49f9-bad4-0f921ac38dbb service neutron] 10.222.0.30 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1572022
May 27 09:36:11.457045 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:11.496139 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-7b813563-bc30-453c-b0d7-d4a89103b4e9 service neutron] 10.222.0.30 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1401353
May 27 09:36:11.819820 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-78a56730-2e5e-4cbb-9de2-6fa4fc267e21 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:11.962674 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8df53b65-875a-4db0-93be-6ea077c083f7 req-13ebd94a-df0d-436b-b48d-501ee0a71e94 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 210 time: 0.0432875
May 27 09:36:12.065273 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57256) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:12.150191 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_v2 [None req-21afbe21-3710-4f64-a64c-de012b075a9a admin admin] Deleting subnet 11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f {{(pid=91820) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:36:12.155966 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-21afbe21-3710-4f64-a64c-de012b075a9a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:12.208616 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-21afbe21-3710-4f64-a64c-de012b075a9a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3483778'] for subnet, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:12.270075 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-21afbe21-3710-4f64-a64c-de012b075a9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:12.404727 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:12.600131 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-21afbe21-3710-4f64-a64c-de012b075a9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2421409', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2490042'] for subnet, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:12.610561 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:12.692629 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21afbe21-3710-4f64-a64c-de012b075a9a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:12.699966 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-21afbe21-3710-4f64-a64c-de012b075a9a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:12.701620 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-21afbe21-3710-4f64-a64c-de012b075a9a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:12.713957 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-21afbe21-3710-4f64-a64c-de012b075a9a admin admin] 10.222.0.30 "DELETE /v2.0/subnets/11eb51b9-1e9e-4c7d-a5d8-eb50b6078b9f HTTP/1.1" status: 204  len: 168 time: 0.6458797
May 27 09:36:12.716495 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57262) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:12.934074 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.160645 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.251336 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6b580fe0-defc-4f18-8745-d7be01804156 req-5e5fa0ff-2fb6-47cf-a795-6badefc8cc33 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 210 time: 0.0948989
May 27 09:36:13.269072 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2eec472910>,) {'filters': {'network_id': ['435a0e3f-efcc-4b4f-9d00-e12d96978c86']}} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:36:13.288739 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec472910>, '94a48d31-baf7-45c2-bce8-12ad5cc3d6a7') {'for_net_delete': True} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:36:13.289019 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec472910>, '94a48d31-baf7-45c2-bce8-12ad5cc3d6a7') {} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:36:13.307361 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3483835'] for segment, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.351468 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.366673 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] Releasing vlan 384 on physical network physnet1 to pool {{(pid=91820) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:36:13.366673 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2421763'] for segment, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.367136 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57278) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]: Traceback (most recent call last):
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     timer()
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     cb(*args, **kw)
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     return func(*args, **kwargs)
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     self._notify()
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     self.callback(batched_events)
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     event.method(event)
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     return f(self, *a, **k)
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._get(url).json()
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self.request(url, 'GET', **kwargs)
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:36:13.379095 dv-cinder-772623-6-iscsi neutron-server[91820]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:36:13.389727 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-656445cc-21c3-421c-b48b-84101145505f req-b997a16a-6b56-4f28-8259-abcbf159c1e3 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:13.390439 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-656445cc-21c3-421c-b48b-84101145505f req-b997a16a-6b56-4f28-8259-abcbf159c1e3 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Synchronizing usage tracker for tenant:b8df97a650014930beb6e52081be8e90 on resource:network {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:36:13.481760 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-656445cc-21c3-421c-b48b-84101145505f req-b997a16a-6b56-4f28-8259-abcbf159c1e3 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Unset dirty status for tenant:b8df97a650014930beb6e52081be8e90 on resource:network {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:36:13.483219 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-b997a16a-6b56-4f28-8259-abcbf159c1e3 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 811 time: 0.4754231
May 27 09:36:13.484364 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.488301 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a3305a9a-b2c1-4692-ba9e-89a1697d2041 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:13.501998 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.506951 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8a213134-b237-4721-bb02-783c0f750ead admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.523271 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-8a213134-b237-4721-bb02-783c0f750ead admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:36:13.528605 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-8a213134-b237-4721-bb02-783c0f750ead admin admin] Usage tracker for resource:security_group_rule and tenant:195a61a6b1e34a53b8175f5822238865 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:36:13.532376 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-8a213134-b237-4721-bb02-783c0f750ead admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:36:13.533190 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] Pushing event deleted for resources: {'Network': ['ID=435a0e3f-efcc-4b4f-9d00-e12d96978c86,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:13.538280 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:13.543742 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-8a213134-b237-4721-bb02-783c0f750ead admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:36:13.550319 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-6fd071ab-cb36-444b-9703-92c1e0493a18 admin admin] 10.222.0.30 "DELETE /v2.0/networks/435a0e3f-efcc-4b4f-9d00-e12d96978c86 HTTP/1.1" status: 204  len: 168 time: 0.8320289
May 27 09:36:13.562684 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-656445cc-21c3-421c-b48b-84101145505f req-fa40d6fa-7cc0-42ee-9a3b-564537046373 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Synchronizing usage tracker for tenant:b8df97a650014930beb6e52081be8e90 on resource:security_group {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:36:13.582159 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-656445cc-21c3-421c-b48b-84101145505f req-fa40d6fa-7cc0-42ee-9a3b-564537046373 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Unset dirty status for tenant:b8df97a650014930beb6e52081be8e90 on resource:security_group {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:36:13.583432 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-fa40d6fa-7cc0-42ee-9a3b-564537046373 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b8df97a650014930beb6e52081be8e90 HTTP/1.1" status: 200  len: 380 time: 0.0786896
May 27 09:36:13.594727 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'port': {'device_id': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'admin_state_up': True, 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'security_groups': ['6de72829-ee9b-4468-8f5f-92fb65675d3b']}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:36:13.651517 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8a213134-b237-4721-bb02-783c0f750ead admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.657020 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8a213134-b237-4721-bb02-783c0f750ead admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.666980 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ee9b96ef-052c-41ec-961e-bd99adc77477 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:13.712088 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a213134-b237-4721-bb02-783c0f750ead admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc8205cf-6316-4f3d-ad83-6bc4ca31b4a4,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:13.719928 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57286) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:13.720375 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57288) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:13.728568 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-8a213134-b237-4721-bb02-783c0f750ead admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=195a61a6b1e34a53b8175f5822238865&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3479242
May 27 09:36:13.730128 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8a213134-b237-4721-bb02-783c0f750ead admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:13.858307 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:36:13.864673 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:port and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:36:13.870044 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for port was recalculated. Used quota:3. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:36:13.876173 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-51940e79-d398-46e3-93bf-da5bbc82666a admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=df5fdd9e30044571812bfe2cc2233af6&name=default HTTP/1.1" status: 200  len: 2979 time: 0.1544137
May 27 09:36:13.879325 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57294) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:13.890516 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:36:13.906483 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-790467eb-b91a-494c-8c26-ac216cf58c8d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.919139 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Made reservation on behalf of b8df97a650014930beb6e52081be8e90 for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:36:13.922855 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.955455 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1e2136e4-b051-40cf-9002-16e2026aca25 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:13.999784 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1e2136e4-b051-40cf-9002-16e2026aca25 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:14.089949 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1e2136e4-b051-40cf-9002-16e2026aca25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:14.094422 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-6e1a23a3-f646-41f7-82a9-4d3aa040fab3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:14.111267 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e2136e4-b051-40cf-9002-16e2026aca25 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4f24706-1975-4704-b0ee-0a487db61b43,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:14.114677 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-1e2136e4-b051-40cf-9002-16e2026aca25 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:14.124385 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-790467eb-b91a-494c-8c26-ac216cf58c8d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:14.136589 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1e2136e4-b051-40cf-9002-16e2026aca25 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:14.141250 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-1e2136e4-b051-40cf-9002-16e2026aca25 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/a4f24706-1975-4704-b0ee-0a487db61b43 HTTP/1.1" status: 204  len: 168 time: 0.2576027
May 27 09:36:14.330698 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-790467eb-b91a-494c-8c26-ac216cf58c8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:14.336597 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8e54867b-a290-43e1-b2e8-fb54b14b45dd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:14.346485 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Allocated IP 172.20.0.13 (d58a455f-cc80-4aa7-a530-ce993d4da5e4/3187e919-f2c3-422d-8e9c-3d158ef72b40/17f52729-5eea-473d-8d2b-fe7fd55dc845) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:36:14.357009 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-790467eb-b91a-494c-8c26-ac216cf58c8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fc8205cf-6316-4f3d-ad83-6bc4ca31b4a4,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:14.365360 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-790467eb-b91a-494c-8c26-ac216cf58c8d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:14.403968 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-790467eb-b91a-494c-8c26-ac216cf58c8d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:14.407623 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-790467eb-b91a-494c-8c26-ac216cf58c8d admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/fc8205cf-6316-4f3d-ad83-6bc4ca31b4a4 HTTP/1.1" status: 204  len: 168 time: 0.6817663
May 27 09:36:14.484243 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8bff4aed-61f7-4033-b61e-63883ad74734 req-4ce92de2-90e3-4ed1-834e-29e333270dad tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 210 time: 0.0643821
May 27 09:36:14.624221 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:14.643062 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Transition to ACTIVE for port object 17f52729-5eea-473d-8d2b-fe7fd55dc845 will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:36:14.674022 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:14.679990 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-974f32f6-31a3-4c66-9080-1b799f10c1e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:14.763462 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Network d58a455f-cc80-4aa7-a530-ce993d4da5e4 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:36:14.766930 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:36:14.770901 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:36:14.802779 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'Port': ['ID=17f52729-5eea-473d-8d2b-fe7fd55dc845,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:14.810594 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:14.831859 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57316) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:14.850367 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:14.851037 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:14.855608 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bf05e319-0561-46d2-a8d0-dee41454b23c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:14.873231 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-bf05e319-0561-46d2-a8d0-dee41454b23c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:36:14.873472 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-8a4d0ae9-8af2-4384-bc0d-058076783592 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 1.2832668
May 27 09:36:14.877775 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-bf05e319-0561-46d2-a8d0-dee41454b23c admin admin] Usage tracker for resource:security_group_rule and tenant:302e8c58f86f45ab8e54ff1afaff61a2 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:36:14.881105 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-bf05e319-0561-46d2-a8d0-dee41454b23c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:36:14.888908 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-bf05e319-0561-46d2-a8d0-dee41454b23c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:36:14.889108 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Request body: {'port': {'device_id': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:36:14.946877 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.004464 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bf05e319-0561-46d2-a8d0-dee41454b23c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.009939 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bf05e319-0561-46d2-a8d0-dee41454b23c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.020606 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-38eb8e17-8ab1-49cd-9c57-281faff03e08 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:15.045803 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.054244 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-7246aadc-d09b-457d-b1d7-7ab6036f2d59 None None] Provisioning for port 17f52729-5eea-473d-8d2b-fe7fd55dc845 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:36:15.062927 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-7246aadc-d09b-457d-b1d7-7ab6036f2d59 None None] Provisioning complete for port 17f52729-5eea-473d-8d2b-fe7fd55dc845 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:36:15.064141 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-bf05e319-0561-46d2-a8d0-dee41454b23c admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=302e8c58f86f45ab8e54ff1afaff61a2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2306738
May 27 09:36:15.065675 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf05e319-0561-46d2-a8d0-dee41454b23c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c98b6be-672a-40f2-a658-a4ed73893076,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:15.067623 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-7246aadc-d09b-457d-b1d7-7ab6036f2d59 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.067969 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57324) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:15.070386 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-bf05e319-0561-46d2-a8d0-dee41454b23c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:15.138424 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7acce7a9-80e1-419d-9fa9-e473d9afe850 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.153693 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-7246aadc-d09b-457d-b1d7-7ab6036f2d59 None None] Port 17f52729-5eea-473d-8d2b-fe7fd55dc845 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:36:15.181425 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7acce7a9-80e1-419d-9fa9-e473d9afe850 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.240482 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7acce7a9-80e1-419d-9fa9-e473d9afe850 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.244700 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-fcba37ef-f319-4dce-a0ad-1cb79370c693 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:15.259555 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7acce7a9-80e1-419d-9fa9-e473d9afe850 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c98b6be-672a-40f2-a658-a4ed73893076,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:15.263132 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7acce7a9-80e1-419d-9fa9-e473d9afe850 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:15.265788 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7acce7a9-80e1-419d-9fa9-e473d9afe850 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.267277 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-7acce7a9-80e1-419d-9fa9-e473d9afe850 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/6c98b6be-672a-40f2-a658-a4ed73893076 HTTP/1.1" status: 204  len: 168 time: 0.1984217
May 27 09:36:15.456976 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 17f52729-5eea-473d-8d2b-fe7fd55dc845 {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:36:15.465971 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.493831 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Transition to ACTIVE for port object 17f52729-5eea-473d-8d2b-fe7fd55dc845 will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:36:15.501086 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.508522 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-bab8dcc8-855d-44f4-81d3-570e59fdc029 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:15.696936 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Pushing event updated for resources: {'Port': ['ID=17f52729-5eea-473d-8d2b-fe7fd55dc845,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:15.712994 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.203s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:15.772310 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c66554a-f1c1-4054-b466-55c42b765aaf req-a7e88db5-e23b-4be0-9aaa-c10756727f77 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:15.774634 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5c66554a-f1c1-4054-b466-55c42b765aaf req-a7e88db5-e23b-4be0-9aaa-c10756727f77 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 944 time: 0.1241045
May 27 09:36:15.852577 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Attempting to bind port 17f52729-5eea-473d-8d2b-fe7fd55dc845 on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:36:15.853188 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Attempting to bind port 17f52729-5eea-473d-8d2b-fe7fd55dc845 by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:36:15.853700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Attempting to bind port 17f52729-5eea-473d-8d2b-fe7fd55dc845 on network d58a455f-cc80-4aa7-a530-ce993d4da5e4 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:36:15.860794 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Port 17f52729-5eea-473d-8d2b-fe7fd55dc845 on network d58a455f-cc80-4aa7-a530-ce993d4da5e4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:36:15.861516 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Attempting to bind port 17f52729-5eea-473d-8d2b-fe7fd55dc845 on network d58a455f-cc80-4aa7-a530-ce993d4da5e4 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:36:15.865870 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5c66554a-f1c1-4054-b466-55c42b765aaf req-5b1aa5cb-3529-4fb3-a721-af28205c15e2 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0805302
May 27 09:36:15.868058 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 35, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:36:15.868593 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Checking segment: {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:36:15.869276 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Bound using segment: {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:36:15.871161 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Bound port: 17f52729-5eea-473d-8d2b-fe7fd55dc845, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:36:15.871747 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.979217 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] For port 17f52729-5eea-473d-8d2b-fe7fd55dc845, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:36:15.983187 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] For port 17f52729-5eea-473d-8d2b-fe7fd55dc845, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:36:15.990541 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:15.996132 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a747c7a8-eb73-4f81-9222-41df2df2886c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:16.055102 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:16.055928 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:16.058354 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] 10.222.0.11 "PUT /v2.0/ports/17f52729-5eea-473d-8d2b-fe7fd55dc845 HTTP/1.1" status: 200  len: 1094 time: 1.1765640
May 27 09:36:16.059138 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'tag': '17f52729-5eea-473d-8d2b-fe7fd55dc845'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:36:16.086792 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Pushing event updated for resources: {'Port': ['ID=17f52729-5eea-473d-8d2b-fe7fd55dc845,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:16.098231 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.102s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:16.153788 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'tag': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'status': 'completed', 'code': 200}
May 27 09:36:16.209875 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-656445cc-21c3-421c-b48b-84101145505f req-4f7b0558-1db6-4333-9896-5cf9c7e364f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:16.213680 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-4f7b0558-1db6-4333-9896-5cf9c7e364f4 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 1097 time: 0.1024561
May 27 09:36:16.290810 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-2b5230bf-bfad-4747-9754-ff604a552ae5 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845 HTTP/1.1" status: 200  len: 217 time: 0.0709937
May 27 09:36:16.473790 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-656445cc-21c3-421c-b48b-84101145505f req-e90d4814-f5e6-41fa-b41a-c14cca3e7188 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:16.475257 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-e90d4814-f5e6-41fa-b41a-c14cca3e7188 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.1789839
May 27 09:36:16.554730 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-656445cc-21c3-421c-b48b-84101145505f req-1f711848-aa71-4d66-bd2f-9ddfdfb60c5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:16.556466 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-1f711848-aa71-4d66-bd2f-9ddfdfb60c5a service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0746284
May 27 09:36:16.704598 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-dc826170-e550-4c01-addc-075ed018b244 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1411355
May 27 09:36:16.844063 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-656445cc-21c3-421c-b48b-84101145505f req-743ff27f-ea88-4023-bb39-a49fe3e7fa00 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1333566
May 27 09:36:16.974046 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be97501c-030e-44ef-aa83-8fa6e47cb4b4 req-eeec1526-01c3-44b8-8fc7-763a18936463 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:16.976729 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-be97501c-030e-44ef-aa83-8fa6e47cb4b4 req-eeec1526-01c3-44b8-8fc7-763a18936463 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 1097 time: 0.0870380
May 27 09:36:17.080336 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8768fd8b-9975-4669-b6d2-bbe20e7a2054 req-eade6248-11be-49b7-81ca-97b055510f5d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:17.081916 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8768fd8b-9975-4669-b6d2-bbe20e7a2054 req-eade6248-11be-49b7-81ca-97b055510f5d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 944 time: 0.0962720
May 27 09:36:17.126555 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be97501c-030e-44ef-aa83-8fa6e47cb4b4 req-c2671490-f1a7-49af-a7f3-e4aa4ce99cde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:17.128578 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-be97501c-030e-44ef-aa83-8fa6e47cb4b4 req-c2671490-f1a7-49af-a7f3-e4aa4ce99cde service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.1456633
May 27 09:36:17.133735 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8768fd8b-9975-4669-b6d2-bbe20e7a2054 req-5730c6f7-00a3-431e-a8b1-ae05d9acc401 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0457840
May 27 09:36:17.204647 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-be97501c-030e-44ef-aa83-8fa6e47cb4b4 req-aa235688-9aa7-4981-ad21-c13254766137 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845 HTTP/1.1" status: 200  len: 217 time: 0.0690727
May 27 09:36:17.275220 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be97501c-030e-44ef-aa83-8fa6e47cb4b4 req-716f32b2-7c92-4e65-8a54-c7d1a6aa2229 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:17.277346 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-be97501c-030e-44ef-aa83-8fa6e47cb4b4 req-716f32b2-7c92-4e65-8a54-c7d1a6aa2229 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0663619
May 27 09:36:17.356695 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be97501c-030e-44ef-aa83-8fa6e47cb4b4 req-8a2fe511-e856-4198-a1c4-7d5ecfd85055 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:17.358356 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-be97501c-030e-44ef-aa83-8fa6e47cb4b4 req-8a2fe511-e856-4198-a1c4-7d5ecfd85055 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0740147
May 27 09:36:17.519630 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-be97501c-030e-44ef-aa83-8fa6e47cb4b4 req-de0c7f49-4950-47fc-aaa9-6aa6e5486086 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1548302
May 27 09:36:17.691143 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-be97501c-030e-44ef-aa83-8fa6e47cb4b4 req-f729df4c-e982-435d-9456-d872708fcfde service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1645238
May 27 09:36:18.336266 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34e31fc-373c-4772-b4c0-9080419a036a req-3d479616-bc79-420b-8039-7ec8fe3756a0 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:18.337853 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a34e31fc-373c-4772-b4c0-9080419a036a req-3d479616-bc79-420b-8039-7ec8fe3756a0 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 944 time: 0.0923452
May 27 09:36:18.395669 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a34e31fc-373c-4772-b4c0-9080419a036a req-9b57e52d-9038-40a1-a3aa-cd01dfbf92d7 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0471923
May 27 09:36:19.591664 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-456477b8-d365-4788-83e9-d182d572d4c4 req-6fad42e9-bb82-4699-a4ae-aa8d68e4cadf tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:19.593159 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-456477b8-d365-4788-83e9-d182d572d4c4 req-6fad42e9-bb82-4699-a4ae-aa8d68e4cadf tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 944 time: 0.0824142
May 27 09:36:19.640522 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-456477b8-d365-4788-83e9-d182d572d4c4 req-c994ebd2-b20e-46b4-b2e3-78e66ac711b2 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0413506
May 27 09:36:20.833604 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a909fbc5-49da-4d26-82ec-9646680e2a96 req-5d3e9270-8d52-4097-ad95-7ebe4eca25f6 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:20.835135 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a909fbc5-49da-4d26-82ec-9646680e2a96 req-5d3e9270-8d52-4097-ad95-7ebe4eca25f6 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 944 time: 0.0884073
May 27 09:36:20.887272 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a909fbc5-49da-4d26-82ec-9646680e2a96 req-a667b83f-1284-4a32-a95d-5680a03e9998 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0460205
May 27 09:36:22.078002 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-689f6cca-d724-44d3-82cb-69770da0a0a5 req-9337a3ae-19b0-4409-aa44-a8fb9e61376d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:22.079602 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-689f6cca-d724-44d3-82cb-69770da0a0a5 req-9337a3ae-19b0-4409-aa44-a8fb9e61376d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 944 time: 0.0818594
May 27 09:36:22.126881 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-689f6cca-d724-44d3-82cb-69770da0a0a5 req-30c0b7f4-4769-41ce-afdf-7a3754845b66 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0415785
May 27 09:36:23.355791 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4080347-56ce-48fd-b242-57f3e4926090 req-db96fdfc-939e-45d5-bcbb-cb0f17072a1a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:23.357325 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e4080347-56ce-48fd-b242-57f3e4926090 req-db96fdfc-939e-45d5-bcbb-cb0f17072a1a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 944 time: 0.0999384
May 27 09:36:23.406310 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e4080347-56ce-48fd-b242-57f3e4926090 req-b84f3715-b130-4e58-b8e0-99923e79cae6 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0430002
May 27 09:36:23.706254 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57466) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:23.827030 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ac5bf4f6-f884-4ca6-8e4e-667b655be821 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:23.849047 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-ac5bf4f6-f884-4ca6-8e4e-667b655be821 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:36:23.855363 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-ac5bf4f6-f884-4ca6-8e4e-667b655be821 admin admin] Usage tracker for resource:security_group_rule and tenant:9ac15290a318467a99d7cb75041180bd is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:36:23.860055 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-ac5bf4f6-f884-4ca6-8e4e-667b655be821 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:36:23.866442 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-ac5bf4f6-f884-4ca6-8e4e-667b655be821 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:36:23.969545 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ac5bf4f6-f884-4ca6-8e4e-667b655be821 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:23.974951 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-ac5bf4f6-f884-4ca6-8e4e-667b655be821 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:23.983795 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0ac32c05-ffff-4fcf-827e-a9c9aea154ff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:24.029793 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-ac5bf4f6-f884-4ca6-8e4e-667b655be821 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9ac15290a318467a99d7cb75041180bd&name=default HTTP/1.1" status: 200  len: 2979 time: 0.3224180
May 27 09:36:24.030582 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac5bf4f6-f884-4ca6-8e4e-667b655be821 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73b706cc-2650-48fe-9896-3f62a4de338e,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:24.032599 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57472) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:24.033981 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ac5bf4f6-f884-4ca6-8e4e-667b655be821 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:24.096553 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-97049917-02c6-4daf-8e82-64790a57a6a3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:24.124383 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-97049917-02c6-4daf-8e82-64790a57a6a3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:24.177291 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-97049917-02c6-4daf-8e82-64790a57a6a3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:24.181043 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-3f0ac278-1f4e-4d87-8834-49432888ad4c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:24.198951 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97049917-02c6-4daf-8e82-64790a57a6a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73b706cc-2650-48fe-9896-3f62a4de338e,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:24.201831 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-97049917-02c6-4daf-8e82-64790a57a6a3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:24.202790 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-97049917-02c6-4daf-8e82-64790a57a6a3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:24.203970 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-97049917-02c6-4daf-8e82-64790a57a6a3 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/73b706cc-2650-48fe-9896-3f62a4de338e HTTP/1.1" status: 204  len: 168 time: 0.1702604
May 27 09:36:24.711677 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c24e37f-f372-41ff-aed5-b5acada94c0c req-af384bf1-c274-4c05-9957-cc84e8af31e5 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:24.713367 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8c24e37f-f372-41ff-aed5-b5acada94c0c req-af384bf1-c274-4c05-9957-cc84e8af31e5 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 944 time: 0.1864390
May 27 09:36:24.763568 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-8c24e37f-f372-41ff-aed5-b5acada94c0c req-5736d01d-cd7a-4b6c-9d8f-50cbfd4d211c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0440454
May 27 09:36:25.805508 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 17f52729-5eea-473d-8d2b-fe7fd55dc845 details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:36:25.943869 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 17f52729-5eea-473d-8d2b-fe7fd55dc845, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:36:25.959492 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'port_id': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'mac_address': 'fa:16:3e:d1:91:42', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 393, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:36:25.970446 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03d75894-1ed9-4830-8927-185cd9d97cad req-dd5afb5f-7f68-44ac-9029-3d69ed496959 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:25.972520 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-03d75894-1ed9-4830-8927-185cd9d97cad req-dd5afb5f-7f68-44ac-9029-3d69ed496959 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 944 time: 0.0910928
May 27 09:36:26.020271 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-03d75894-1ed9-4830-8927-185cd9d97cad req-e0b49910-e116-4d2d-9afb-c2eec3d6c1cd tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0417039
May 27 09:36:26.023289 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:26.044143 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 17f52729-5eea-473d-8d2b-fe7fd55dc845 {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:36:26.060386 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 17f52729-5eea-473d-8d2b-fe7fd55dc845, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:36:26.067171 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:26.070096 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-1e404ad3-a675-48ed-9e52-5110200f67ce None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:26.140121 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=17f52729-5eea-473d-8d2b-fe7fd55dc845,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:26.148579 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.148922 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.149261 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.149595 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.149927 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.150256 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.150589 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.151504 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.151870 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.152196 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.152522 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.152845 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:26.157008 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:26.270188 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['17f52729-5eea-473d-8d2b-fe7fd55dc845'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:36:26.504542 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:27.218302 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0215184c-5e42-4ebd-ba8a-b8877875edf7 req-5d74515d-3678-4a3f-9f29-4ed8d6725928 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:27.219921 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0215184c-5e42-4ebd-ba8a-b8877875edf7 req-5d74515d-3678-4a3f-9f29-4ed8d6725928 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 945 time: 0.0919468
May 27 09:36:27.274589 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0215184c-5e42-4ebd-ba8a-b8877875edf7 req-56b84358-23e8-410d-8693-248514414fc8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0485301
May 27 09:36:27.820665 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 17f52729-5eea-473d-8d2b-fe7fd55dc845 up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:36:27.896131 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 17f52729-5eea-473d-8d2b-fe7fd55dc845 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:36:27.902490 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 17f52729-5eea-473d-8d2b-fe7fd55dc845 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:36:27.902851 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:28.032941 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:28.062476 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17f52729-5eea-473d-8d2b-fe7fd55dc845'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:36:28.074238 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 17f52729-5eea-473d-8d2b-fe7fd55dc845, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:36:28.081112 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:28.084333 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:28.137912 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'code': 200}
May 27 09:36:28.161898 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=17f52729-5eea-473d-8d2b-fe7fd55dc845,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:28.164793 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:28.411545 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec2d588a-679c-4fbf-a6a1-62c5c3dcf920 req-c48ba2cb-ac67-4392-9ab7-ea7f304f0603 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:28.414370 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ec2d588a-679c-4fbf-a6a1-62c5c3dcf920 req-c48ba2cb-ac67-4392-9ab7-ea7f304f0603 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 1099 time: 0.0778985
May 27 09:36:28.457659 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-ec2d588a-679c-4fbf-a6a1-62c5c3dcf920 req-0fb3e1a7-f5a6-4970-96c2-be0e230ef9de service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0380826
May 27 09:36:28.469498 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f6d5d9d-b65b-460d-b4fb-43066a0bec7d req-df5a6907-3212-4a19-8d5b-71297a312ad2 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:28.471046 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5f6d5d9d-b65b-460d-b4fb-43066a0bec7d req-df5a6907-3212-4a19-8d5b-71297a312ad2 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 946 time: 0.0837069
May 27 09:36:28.519764 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5f6d5d9d-b65b-460d-b4fb-43066a0bec7d req-39d086c9-da60-4b98-8f4d-69bce4c8d79c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0426219
May 27 09:36:29.717252 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd7e28e-f3b4-42d6-94ad-58502457ed16 req-eb2c6b74-e934-4987-b7ac-8b19b51d747a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:29.718744 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4bd7e28e-f3b4-42d6-94ad-58502457ed16 req-eb2c6b74-e934-4987-b7ac-8b19b51d747a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 946 time: 0.0897388
May 27 09:36:29.768453 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4bd7e28e-f3b4-42d6-94ad-58502457ed16 req-e3cd7b33-29ab-43cb-bc62-aeb3b06bfae0 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435433
May 27 09:36:29.962399 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e62eca9-397b-4226-a736-1d18a8d3dd5a req-bf3b534e-7b8a-4a2a-a54e-365369acc3b3 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:29.964904 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2e62eca9-397b-4226-a736-1d18a8d3dd5a req-bf3b534e-7b8a-4a2a-a54e-365369acc3b3 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 946 time: 0.0863826
May 27 09:36:30.012305 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2e62eca9-397b-4226-a736-1d18a8d3dd5a req-3e2423fc-909d-4bc3-ba22-bb6af32d6064 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0417943
May 27 09:36:30.035421 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57528) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:30.112448 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0d647f72-fc90-4e2a-8b5d-6bc6aca943c6 tempest-TestVolumeBootPattern-1068691054 tempest-TestVolumeBootPattern-1068691054-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:30.113163 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0d647f72-fc90-4e2a-8b5d-6bc6aca943c6 tempest-TestVolumeBootPattern-1068691054 tempest-TestVolumeBootPattern-1068691054-project-admin] Synchronizing usage tracker for tenant:84f0499276a14bb58311b0634f9b1dde on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:36:30.132310 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0d647f72-fc90-4e2a-8b5d-6bc6aca943c6 tempest-TestVolumeBootPattern-1068691054 tempest-TestVolumeBootPattern-1068691054-project-admin] Unset dirty status for tenant:84f0499276a14bb58311b0634f9b1dde on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:36:30.133886 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-0d647f72-fc90-4e2a-8b5d-6bc6aca943c6 tempest-TestVolumeBootPattern-1068691054 tempest-TestVolumeBootPattern-1068691054-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 1094 time: 0.0973334
May 27 09:36:30.137122 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57532) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:30.142356 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'floatingip': {'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'port_id': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address': '172.20.0.13'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:36:30.148648 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:36:30.153371 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:floatingip and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:36:30.156285 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:36:30.162112 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:36:30.174019 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:30.319757 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:30.482400 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Allocated IP 172.27.1.30 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/ae2f80ab-9f6a-49e1-bb56-3c2898aedfea) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:36:30.575055 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57542) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:30.649396 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:30.689137 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:30.693321 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0e5e7ae7-7e13-4aeb-acee-ccdc375698bb tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:30.724391 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8ff7d7f6-ca07-4155-852e-3ec562658cb0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:30.754179 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-8ff7d7f6-ca07-4155-852e-3ec562658cb0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:36:30.759099 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:36:30.759821 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-8ff7d7f6-ca07-4155-852e-3ec562658cb0 admin admin] Usage tracker for resource:security_group_rule and tenant:07246b3477244f5fa684f3d19280cfea is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:36:30.762920 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:36:30.766854 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:36:30.798445 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-8ff7d7f6-ca07-4155-852e-3ec562658cb0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:36:30.801611 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'Port': ['ID=ae2f80ab-9f6a-49e1-bb56-3c2898aedfea,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:30.813729 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-8ff7d7f6-ca07-4155-852e-3ec562658cb0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:36:30.820334 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.820716 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.821091 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.821572 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.821819 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.822181 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.823081 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.823462 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.823823 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.824180 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.824538 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.824889 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:36:30.830517 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:30.905792 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-aa2a8b33-b9ec-4a0f-a75b-f29ed5b077c6 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1472702
May 27 09:36:30.946331 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8ff7d7f6-ca07-4155-852e-3ec562658cb0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:30.951277 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8ff7d7f6-ca07-4155-852e-3ec562658cb0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:30.960615 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-ac5bf4f6-f884-4ca6-8e4e-667b655be821 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:31.054147 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-8ff7d7f6-ca07-4155-852e-3ec562658cb0 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=07246b3477244f5fa684f3d19280cfea&name=default HTTP/1.1" status: 200  len: 2979 time: 0.4776173
May 27 09:36:31.055849 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ff7d7f6-ca07-4155-852e-3ec562658cb0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=46b85fe4-5bed-4797-bca9-c0377a066632,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:31.057764 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57548) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:31.065058 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8ff7d7f6-ca07-4155-852e-3ec562658cb0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:31.090692 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-d95a3d0b-2f36-4ad1-be8a-0fa47c339732 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:31.092315 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-d95a3d0b-2f36-4ad1-be8a-0fa47c339732 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 1099 time: 0.1077175
May 27 09:36:31.226670 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bb1b0bf5-ed3b-4daf-b57d-d08746953990 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:31.251127 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-42b3c222-ff40-4402-bb40-a07695217e11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:31.252716 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-42b3c222-ff40-4402-bb40-a07695217e11 service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.1395590
May 27 09:36:31.260358 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bb1b0bf5-ed3b-4daf-b57d-d08746953990 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:31.437998 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:31.438654 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-95f1981b-34a4-4586-9837-8c641088fde4 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845 HTTP/1.1" status: 200  len: 217 time: 0.1794567
May 27 09:36:31.441188 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bb1b0bf5-ed3b-4daf-b57d-d08746953990 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:31.450266 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7cbf5a1f-be41-4129-9792-2afadc8e69a7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:31.466636 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb1b0bf5-ed3b-4daf-b57d-d08746953990 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=46b85fe4-5bed-4797-bca9-c0377a066632,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:31.476185 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-bb1b0bf5-ed3b-4daf-b57d-d08746953990 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:31.514313 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-c814f1ca-be45-480d-8049-e399e56706f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:31.515970 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-c814f1ca-be45-480d-8049-e399e56706f7 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0709224
May 27 09:36:31.535913 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bb1b0bf5-ed3b-4daf-b57d-d08746953990 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:31.537146 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-bb1b0bf5-ed3b-4daf-b57d-d08746953990 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/46b85fe4-5bed-4797-bca9-c0377a066632 HTTP/1.1" status: 204  len: 168 time: 0.4783287
May 27 09:36:31.546943 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:31.601975 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-3ebf5d93-62dd-4535-b995-cd792d3d310f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:31.603722 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-3ebf5d93-62dd-4535-b995-cd792d3d310f service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0819275
May 27 09:36:31.754344 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-2a817fce-c52b-49c1-b135-c110689dd52b service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1443226
May 27 09:36:31.794082 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:31.799795 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:31.804881 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:31.892488 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57556) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:31.904391 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-52a3c3d3-3792-4c9e-9f87-07ed1eb45777 req-51078423-859b-493a-9a69-d8fe5fc54ce4 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1419902
May 27 09:36:31.934899 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e75dd4b7-6ba7-4a41-9594-24a1bbd58471 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:31.953106 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'Port': ['ID=ae2f80ab-9f6a-49e1-bb56-3c2898aedfea,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:31.960401 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:31.967761 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-e75dd4b7-6ba7-4a41-9594-24a1bbd58471 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:36:31.973500 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:32.021732 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-e75dd4b7-6ba7-4a41-9594-24a1bbd58471 admin admin] Usage tracker for resource:security_group_rule and tenant:8e937462e6dc41ec86c6ea3f86c7a3f0 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:36:32.034218 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-e75dd4b7-6ba7-4a41-9594-24a1bbd58471 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:36:32.048737 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-e75dd4b7-6ba7-4a41-9594-24a1bbd58471 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:36:32.190582 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.l3_db [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Floating IP 7d9344fd-2118-4536-92dd-e198af5c71ff associated. External IP: 172.27.1.30, port: 17f52729-5eea-473d-8d2b-fe7fd55dc845.
May 27 09:36:32.391212 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e75dd4b7-6ba7-4a41-9594-24a1bbd58471 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:32.397295 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-e75dd4b7-6ba7-4a41-9594-24a1bbd58471 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:32.410563 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-f2eb5ac8-a7d8-4f7f-9048-bbebbe910438 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:32.460136 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e75dd4b7-6ba7-4a41-9594-24a1bbd58471 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ee75ae18-7b4e-44fd-b0a2-fee8a73aa0c4,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:32.465283 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-e75dd4b7-6ba7-4a41-9594-24a1bbd58471 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=8e937462e6dc41ec86c6ea3f86c7a3f0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.5693729
May 27 09:36:32.468069 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57560) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:36:32.514693 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e75dd4b7-6ba7-4a41-9594-24a1bbd58471 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:32.544024 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6e6c3c8e-c92e-4cee-aadc-91f471d8cda3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:32.575659 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6e6c3c8e-c92e-4cee-aadc-91f471d8cda3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:32.630979 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6e6c3c8e-c92e-4cee-aadc-91f471d8cda3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:32.636606 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-27586c8e-856f-4b14-87b3-3534191a0d30 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:36:32.651469 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e6c3c8e-c92e-4cee-aadc-91f471d8cda3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee75ae18-7b4e-44fd-b0a2-fee8a73aa0c4,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:36:32.655471 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6e6c3c8e-c92e-4cee-aadc-91f471d8cda3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:36:32.662718 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:36:32.664585 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6e6c3c8e-c92e-4cee-aadc-91f471d8cda3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:32.665746 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-6e6c3c8e-c92e-4cee-aadc-91f471d8cda3 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/ee75ae18-7b4e-44fd-b0a2-fee8a73aa0c4 HTTP/1.1" status: 204  len: 168 time: 0.1966860
May 27 09:36:32.900021 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:36:32.917075 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e641c809-1974-4901-a3d5-dcb6e49cb5b8 None None] Sync routers for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:36:32.928606 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e641c809-1974-4901-a3d5-dcb6e49cb5b8 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:36:32.930366 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-e641c809-1974-4901-a3d5-dcb6e49cb5b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd8ea60>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:36:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:36:32.937540 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:33.015548 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-9d73d46e-f21c-4b76-bef9-ad4c7285a3f8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 996 time: 2.8678372
May 27 09:36:33.015548 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'tag': '17f52729-5eea-473d-8d2b-fe7fd55dc845'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:36:33.073906 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'tag': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'status': 'completed', 'code': 200}
May 27 09:36:33.181626 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fbe210e-fbe9-4db7-b180-67fe44508fdf req-bfd8e9a2-f905-4b29-ac74-604ed363a69c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:33.183729 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-0fbe210e-fbe9-4db7-b180-67fe44508fdf req-bfd8e9a2-f905-4b29-ac74-604ed363a69c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 1099 time: 0.0880220
May 27 09:36:33.227972 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-e641c809-1974-4901-a3d5-dcb6e49cb5b8 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:36:33.350486 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fbe210e-fbe9-4db7-b180-67fe44508fdf req-9e33344c-e89b-4238-a26c-0c751a8ed55b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:33.352165 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-0fbe210e-fbe9-4db7-b180-67fe44508fdf req-9e33344c-e89b-4238-a26c-0c751a8ed55b service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.1606781
May 27 09:36:33.493980 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-0fbe210e-fbe9-4db7-b180-67fe44508fdf req-c5e239e1-31cc-4499-b64c-52475e7026bf service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845 HTTP/1.1" status: 200  len: 999 time: 0.1337321
May 27 09:36:33.566380 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fbe210e-fbe9-4db7-b180-67fe44508fdf req-1d08c738-85e8-42e6-8873-16eace60ed0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:33.567879 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-0fbe210e-fbe9-4db7-b180-67fe44508fdf req-1d08c738-85e8-42e6-8873-16eace60ed0f service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0658810
May 27 09:36:33.650590 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fbe210e-fbe9-4db7-b180-67fe44508fdf req-53d8ff0c-1fef-4d90-9175-14534e601b6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:36:33.652193 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-0fbe210e-fbe9-4db7-b180-67fe44508fdf req-53d8ff0c-1fef-4d90-9175-14534e601b6e service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0778999
May 27 09:36:33.699359 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-e641c809-1974-4901-a3d5-dcb6e49cb5b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd8ea60>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '7d9344fd-2118-4536-92dd-e198af5c71ff', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.30', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:d1:91:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:36:31Z', 'updated_at': '2021-05-27T09:36:31Z', 'revision_number': 0, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:36:33.703835 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e641c809-1974-4901-a3d5-dcb6e49cb5b8 None None] Checking router: 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:36:33.712465 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e641c809-1974-4901-a3d5-dcb6e49cb5b8 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:36:33.713886 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-e641c809-1974-4901-a3d5-dcb6e49cb5b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd8ea60>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:36:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:36:33.799713 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-0fbe210e-fbe9-4db7-b180-67fe44508fdf req-842ba129-e4c1-4367-bd79-b0c4c8ea7ef0 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1406858
May 27 09:36:33.948770 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-0fbe210e-fbe9-4db7-b180-67fe44508fdf req-c8ef6054-913a-4a42-a0d0-b54e660c615b service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1419575
May 27 09:36:33.959648 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-e641c809-1974-4901-a3d5-dcb6e49cb5b8 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:36:34.329201 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-e641c809-1974-4901-a3d5-dcb6e49cb5b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd8ea60>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '7d9344fd-2118-4536-92dd-e198af5c71ff', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.30', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:d1:91:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:36:31Z', 'updated_at': '2021-05-27T09:36:31Z', 'revision_number': 0, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:36:34.333511 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e641c809-1974-4901-a3d5-dcb6e49cb5b8 None None] The sync data for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi is: [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '7d9344fd-2118-4536-92dd-e198af5c71ff', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.30', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:d1:91:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:36:31Z', 'updated_at': '2021-05-27T09:36:31Z', 'revision_number': 0, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:36:34.528198 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f03106f2-eae3-43c9-aa00-7662b00386f6 None None] New status for floating IP 7d9344fd-2118-4536-92dd-e198af5c71ff: ACTIVE {{(pid=91823) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:36:38.514718 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-53e19316-bf13-4ced-8c2f-3ae29a7320a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:41.459458 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:41.824544 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-11aee507-0f7c-464f-82b6-c2165cff8314 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:42.388059 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:44.938361 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:36:48.106480 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:36:56.474901 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:08.517943 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-f453e3f8-eb20-4e31-bd2d-52c871288850 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:11.461303 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:11.826753 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-c93f33fc-21dd-46f9-a2b5-72cb0b364b48 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:12.370632 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57824) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:12.392008 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:12.492244 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:12.506952 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:37:12.510833 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Usage tracker for resource:security_group_rule and tenant:6426a0a542474249b5e1383e99ed62e0 is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:37:12.513791 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:37:12.519614 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:37:12.606218 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:12.610803 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:12.617687 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8774686c-70f3-40f4-a4e1-4e1a813e77bb tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:12.656836 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=de87afa1-d92f-45dc-9863-105267090295,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:12.660571 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6426a0a542474249b5e1383e99ed62e0&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2884121
May 27 09:37:12.663356 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57832) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:12.666991 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.667399 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.667781 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.668652 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.669023 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.669395 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.669765 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.670124 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.670486 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.670846 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.671204 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.671584 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:12.675424 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-8556b7f6-466e-411a-89a7-615888e1cde5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.058s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:12.727462 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1df9f8ac-66b1-433d-912d-02c42cf9d1a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:12.756712 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1df9f8ac-66b1-433d-912d-02c42cf9d1a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:12.909093 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1df9f8ac-66b1-433d-912d-02c42cf9d1a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:12.912599 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8a213134-b237-4721-bb02-783c0f750ead admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:12.925442 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df9f8ac-66b1-433d-912d-02c42cf9d1a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=de87afa1-d92f-45dc-9863-105267090295,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:12.928302 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-1df9f8ac-66b1-433d-912d-02c42cf9d1a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:12.930165 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1df9f8ac-66b1-433d-912d-02c42cf9d1a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:12.931261 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-1df9f8ac-66b1-433d-912d-02c42cf9d1a9 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/de87afa1-d92f-45dc-9863-105267090295 HTTP/1.1" status: 204  len: 168 time: 0.2667749
May 27 09:37:14.939258 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:25.105543 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:37:26.479655 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:31.924535 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-66b5ca3f-524f-424d-9056-4051bac699a9 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1779244
May 27 09:37:32.063164 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-7bf337f6-8cce-47c7-a359-77ef47f45630 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:37:32.064685 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-7bf337f6-8cce-47c7-a359-77ef47f45630 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 1099 time: 0.0700459
May 27 09:37:32.300312 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-81c0f055-f436-4462-bd1d-56306d7a0b5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:37:32.301661 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-81c0f055-f436-4462-bd1d-56306d7a0b5a service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.2174747
May 27 09:37:32.403601 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-29d87041-09f4-4bb3-887a-48ee3bd0cc82 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845 HTTP/1.1" status: 200  len: 1001 time: 0.0955243
May 27 09:37:32.469502 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-260653bf-6c20-48e5-a89d-be28d85f13ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:37:32.470949 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-260653bf-6c20-48e5-a89d-be28d85f13ea service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0618651
May 27 09:37:32.546670 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-498bd067-aad7-4a09-aa00-f97332b3f0ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:37:32.548191 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-498bd067-aad7-4a09-aa00-f97332b3f0ba service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0710075
May 27 09:37:32.559076 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-11e124f2-e68b-4e99-b5f0-2e9dd163ace6 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91820) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:37:32.560114 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-11e124f2-e68b-4e99-b5f0-2e9dd163ace6 service neutron] 10.222.0.11 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0052881
May 27 09:37:32.692801 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-dd80fad1-4960-4a14-b233-f882431dd912 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1259570
May 27 09:37:32.827546 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-cedaca4b-a257-40c4-8293-7bbea41e0a6f req-a1a39cc2-62d2-44da-a4d8-5693400240fc service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1288257
May 27 09:37:34.369251 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 57976) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:34.487171 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:34.501312 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:37:34.505304 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Usage tracker for resource:security_group_rule and tenant:6dc5a327fcdd46eab8c1788a527d9aa2 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:37:34.508126 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:37:34.514334 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:37:34.595760 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:34.600053 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:34.607138 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-36f40695-f318-4480-bf8a-9f50a269dd6f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:34.649168 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=6dc5a327fcdd46eab8c1788a527d9aa2&name=default HTTP/1.1" status: 200  len: 2979 time: 0.2788401
May 27 09:37:34.650073 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8741bdfd-47bf-49c7-bbff-17a6adf97358,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:34.651902 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 57982) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:34.657709 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.658089 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.658458 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.658820 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.659176 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.659571 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.659926 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.660277 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.660629 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.660978 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.661325 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.661672 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:34.665688 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-d0b71b83-1685-4ca0-8294-4c6ed2972774 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:34.710889 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d172e4f-d8da-4038-a50d-40e729b49f59 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:34.735511 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d172e4f-d8da-4038-a50d-40e729b49f59 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:34.791883 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d172e4f-d8da-4038-a50d-40e729b49f59 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:34.796009 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-187122a4-2a13-4a10-a50f-1357714b6358 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:34.809382 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d172e4f-d8da-4038-a50d-40e729b49f59 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8741bdfd-47bf-49c7-bbff-17a6adf97358,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:34.813186 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1d172e4f-d8da-4038-a50d-40e729b49f59 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:34.818494 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d172e4f-d8da-4038-a50d-40e729b49f59 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:34.819648 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-1d172e4f-d8da-4038-a50d-40e729b49f59 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/8741bdfd-47bf-49c7-bbff-17a6adf97358 HTTP/1.1" status: 204  len: 168 time: 0.1666451
May 27 09:37:35.499476 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58006) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:35.603078 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-654171515-network', 'tenant_id': '892895f1788940b1bc09406239590e3f'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:37:35.607800 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:37:35.611609 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Usage tracker for resource:network and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:37:35.614417 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:37:35.624445 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:37:35.634063 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Made reservation on behalf of 892895f1788940b1bc09406239590e3f for: {'network': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:37:35.636370 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:35.650451 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:35.664568 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:37:35.669343 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Usage tracker for resource:security_group_rule and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:37:35.672689 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:37:35.678408 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:37:35.759628 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:35.763358 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:35.766259 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-1e2136e4-b051-40cf-9002-16e2026aca25 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:35.795524 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] vlan segment allocate from pool success with {'vlan_id': 398, 'physical_network': 'physnet1'}  {{(pid=91821) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:37:35.800634 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b685e495-f031-4397-8903-69c0d36e6321,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:35.804159 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:35.807970 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:35.809700 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.segments_db [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Added segment 3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd of type vlan for network 8969d19b-2ae2-4dd6-9861-e28e315bba3f
May 27 09:37:35.846564 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:35.877244 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:35.878556 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:37:35.879133 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:35.883699 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:35.989811 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Pushing event updated for resources: {'Network': ['ID=8969d19b-2ae2-4dd6-9861-e28e315bba3f,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:35.991824 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:35.993476 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 0.4929039
May 27 09:37:35.996552 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58012) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:35.999457 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network 8969d19b-2ae2-4dd6-9861-e28e315bba3f details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:37:36.002933 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Request body: {'subnet': {'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-654171515-subnet', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'ip_version': 4}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:37:36.007838 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:37:36.012239 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Usage tracker for resource:subnet and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:37:36.015592 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:37:36.021318 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:37:36.032700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Made reservation on behalf of 892895f1788940b1bc09406239590e3f for: {'subnet': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:37:36.035123 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2490007'] for subnet, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:36.421871 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2421472', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2489985'] for subnet, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:36.426039 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c0326bb7-1469-4f71-800c-97dd179b4e2a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:36.498737 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Pushing event updated for resources: {'Subnet': ['ID=c1677eac-45e9-4a22-9a63-044a5ded43ac,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:36.502079 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:36.507862 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Checking segment: {'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:37:36.508222 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Network hostable DHCP agents. Network: 8969d19b-2ae2-4dd6-9861-e28e315bba3f, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91820) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:37:36.525135 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Network 8969d19b-2ae2-4dd6-9861-e28e315bba3f is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91820) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:37:36.533965 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, 8969d19b-2ae2-4dd6-9861-e28e315bba3f) {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:37:36.542266 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:37:36.543597 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:36.543972 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85433abf-4671-4795-8ef9-f5207eaf24b2 None None] Network 8969d19b-2ae2-4dd6-9861-e28e315bba3f requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:37:36.564536 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-164eb8d9-7b95-4e39-a476-6e66e6c1006c admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 0.5668821
May 27 09:37:36.567236 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58016) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:36.572493 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:37:36.577994 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:37:36.581777 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Usage tracker for resource:router and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:37:36.584607 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:37:36.591330 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:37:36.604313 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3812772', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1963'] for router, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:36.605446 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3855012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3811180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3881146', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1952'] for router, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:36.620974 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:36.809870 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-91f53f04-080e-4935-b372-154faf69846a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp391d76a4-97d4-5c01-84fd-9bc405269bae-8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'fixed_ips': [{'subnet_id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac'}]}} from dv-cinder-772623-6-iscsi. {{(pid=91822) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 27 09:37:36.810700 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:36.889188 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3811195', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3812794', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2006'] for router, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:36.964674 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.db_base_plugin_common [None req-91f53f04-080e-4935-b372-154faf69846a None None] Allocated IP 172.20.0.2 (8969d19b-2ae2-4dd6-9861-e28e315bba3f/c1677eac-45e9-4a22-9a63-044a5ded43ac/0185e826-e937-479b-b6f5-990810f8a591) {{(pid=91822) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:37:37.171971 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Notify callbacks [] for port, precommit_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:37.182036 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-91f53f04-080e-4935-b372-154faf69846a None None] Transition to ACTIVE for port object 0185e826-e937-479b-b6f5-990810f8a591 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:37:37.200590 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-91f53f04-080e-4935-b372-154faf69846a None None] Transition to ACTIVE for port object 0185e826-e937-479b-b6f5-990810f8a591 will not be triggered until provisioned by entity DHCP. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:37:37.205851 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:37.209498 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:37.210271 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:37.240797 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:37.271905 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-91f53f04-080e-4935-b372-154faf69846a None None] Network 8969d19b-2ae2-4dd6-9861-e28e315bba3f is already hosted by enough agents. {{(pid=91822) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:37:37.274788 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.base_scheduler [None req-91f53f04-080e-4935-b372-154faf69846a None None] Resources bound (agent type, host, resource id):  {{(pid=91822) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:37:37.278744 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-91f53f04-080e-4935-b372-154faf69846a None None] Received port after_create {{(pid=91822) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:37:37.318324 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f53f04-080e-4935-b372-154faf69846a None None] Pushing event updated for resources: {'Port': ['ID=0185e826-e937-479b-b6f5-990810f8a591,revision_number=1']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:37.358922 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.359270 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.359647 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.359985 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.360331 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.360652 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.360979 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.361307 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.361641 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.361963 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.362284 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.362605 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:37.370664 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-91f53f04-080e-4935-b372-154faf69846a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:37.380907 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Allocated IP 172.27.1.180 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/63e2bf20-0d18-46a4-9d87-4773d39f55c2) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:37:37.386102 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-91f53f04-080e-4935-b372-154faf69846a None None] Attempting to bind port 0185e826-e937-479b-b6f5-990810f8a591 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:37:37.386481 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-91f53f04-080e-4935-b372-154faf69846a None None] Attempting to bind port 0185e826-e937-479b-b6f5-990810f8a591 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:37:37.387403 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91f53f04-080e-4935-b372-154faf69846a None None] Attempting to bind port 0185e826-e937-479b-b6f5-990810f8a591 on network 8969d19b-2ae2-4dd6-9861-e28e315bba3f {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:37:37.392985 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91f53f04-080e-4935-b372-154faf69846a None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 37, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:37:37.393461 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91f53f04-080e-4935-b372-154faf69846a None None] Checking segment: {'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:37:37.393954 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:37.394433 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-91f53f04-080e-4935-b372-154faf69846a None None] Bound using segment: {'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:37:37.394988 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-91f53f04-080e-4935-b372-154faf69846a None None] Bound port: 0185e826-e937-479b-b6f5-990810f8a591, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:37:37.395508 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:37.491020 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-91f53f04-080e-4935-b372-154faf69846a None None] For port 0185e826-e937-479b-b6f5-990810f8a591, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:37:37.494527 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-91f53f04-080e-4935-b372-154faf69846a None None] For port 0185e826-e937-479b-b6f5-990810f8a591, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=0185e826-e937-479b-b6f5-990810f8a591,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:37:37.498228 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-91f53f04-080e-4935-b372-154faf69846a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:37.502887 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:37.532719 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:37.562640 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:37.567026 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:37.596181 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91f53f04-080e-4935-b372-154faf69846a None None] Pushing event updated for resources: {'Port': ['ID=0185e826-e937-479b-b6f5-990810f8a591,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:37.599586 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-91f53f04-080e-4935-b372-154faf69846a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:37.630166 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:37:37.633082 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:37:37.636909 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:37:37.784438 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Pushing event updated for resources: {'Port': ['ID=63e2bf20-0d18-46a4-9d87-4773d39f55c2,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:37.790293 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.223s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:38.174025 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:38.486039 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bec0f0f-6a22-46f7-bcf2-d429c46070eb None None] Network 8969d19b-2ae2-4dd6-9861-e28e315bba3f requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:37:38.524376 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3812787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3811082'] for router, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:38.580093 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 0185e826-e937-479b-b6f5-990810f8a591 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:38.621152 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-eea6be3c-51ff-4160-ab4f-534c493b2e1d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:38.641896 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-18446335-5c9d-42a3-b4c0-19a3e0ea94be None None] Provisioning for port 0185e826-e937-479b-b6f5-990810f8a591 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:37:38.727894 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 0185e826-e937-479b-b6f5-990810f8a591 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:37:38.738295 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 is scheduled to L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 with binding_index 1 {{(pid=91821) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 27 09:37:38.743113 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 0185e826-e937-479b-b6f5-990810f8a591 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:38.743534 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:38.920507 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:37:38.924725 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:38.937356 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Sync routers for ids ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:37:38.953733 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Notify callbacks [] for router, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:38.955679 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 2.3871913
May 27 09:37:38.959082 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58020) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:38.961712 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Routers {'15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:37:38.962478 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed05b610>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:37:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:39.046089 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 0185e826-e937-479b-b6f5-990810f8a591, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=0185e826-e937-479b-b6f5-990810f8a591,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:37:39.051869 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:39.055637 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:39.264647 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-e7715b56-234a-4a30-a533-49969c00769a None None] Provisioning complete for port 0185e826-e937-479b-b6f5-990810f8a591 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:39.265159 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e7715b56-234a-4a30-a533-49969c00769a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:39.292102 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=0185e826-e937-479b-b6f5-990810f8a591,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:39.296302 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Set router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:37:39.398022 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.342s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:39.661484 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed05b610>, [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:37Z', 'revision_number': 3, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:39.665538 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Checking router: 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:37:39.665899 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Updating router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 port 63e2bf20-0d18-46a4-9d87-4773d39f55c2 binding host dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:37:39.722903 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:39.782784 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:39.987895 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Allocated IP 172.20.0.1 (8969d19b-2ae2-4dd6-9861-e28e315bba3f/c1677eac-45e9-4a22-9a63-044a5ded43ac/c7ac200f-e253-44d5-8112-cc54a37d8ba6) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:37:40.053291 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Notify callbacks [] for port, precommit_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.065130 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Transition to ACTIVE for port object 63e2bf20-0d18-46a4-9d87-4773d39f55c2 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:37:40.071599 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.076500 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:40.144683 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.149773 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Attempting to bind port 63e2bf20-0d18-46a4-9d87-4773d39f55c2 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:37:40.150164 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Attempting to bind port 63e2bf20-0d18-46a4-9d87-4773d39f55c2 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:37:40.150536 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Attempting to bind port 63e2bf20-0d18-46a4-9d87-4773d39f55c2 on network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:37:40.156813 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09205d1f-262b-4458-ad98-5fbb5699b95f None None] Pushing event updated for resources: {'Port': ['ID=63e2bf20-0d18-46a4-9d87-4773d39f55c2,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:40.160751 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-09205d1f-262b-4458-ad98-5fbb5699b95f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:40.161393 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Transition to ACTIVE for port object c7ac200f-e253-44d5-8112-cc54a37d8ba6 will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:37:40.161518 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 37, 11), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:37:40.161878 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Checking segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:37:40.162288 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.162677 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Bound using segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:37:40.163151 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Bound port: 63e2bf20-0d18-46a4-9d87-4773d39f55c2, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:37:40.164029 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.186992 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.191690 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-86a83f96-99c8-4250-a80f-6733309cc097 tempest-VolumesActionsTest-1249172602 tempest-VolumesActionsTest-1249172602-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:40.239324 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] For port 63e2bf20-0d18-46a4-9d87-4773d39f55c2, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:37:40.242227 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] For port 63e2bf20-0d18-46a4-9d87-4773d39f55c2, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=63e2bf20-0d18-46a4-9d87-4773d39f55c2,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:37:40.248287 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.252625 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:40.256511 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Network 8969d19b-2ae2-4dd6-9861-e28e315bba3f is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:37:40.259269 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:37:40.262290 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:37:40.313078 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Pushing event updated for resources: {'Port': ['ID=c7ac200f-e253-44d5-8112-cc54a37d8ba6,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:40.322828 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:40.332527 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3816556'] for router_interface, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.334841 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Routers {'15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:37:40.335520 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed05b610>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:37:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:40.406926 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09205d1f-262b-4458-ad98-5fbb5699b95f None None] Pushing event updated for resources: {'Port': ['ID=63e2bf20-0d18-46a4-9d87-4773d39f55c2,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:40.411940 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-09205d1f-262b-4458-ad98-5fbb5699b95f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:40.521890 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-f34edfa1-0225-4b7a-868f-46e649102343 None None] Provisioning for port c7ac200f-e253-44d5-8112-cc54a37d8ba6 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:37:40.531979 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 0185e826-e937-479b-b6f5-990810f8a591 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:40.565571 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-f34edfa1-0225-4b7a-868f-46e649102343 None None] Provisioning complete for port c7ac200f-e253-44d5-8112-cc54a37d8ba6 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:40.565949 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-f34edfa1-0225-4b7a-868f-46e649102343 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.598439 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.632483 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] Set router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:37:40.822390 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-f34edfa1-0225-4b7a-868f-46e649102343 None None] Port c7ac200f-e253-44d5-8112-cc54a37d8ba6 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:37:40.842423 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.848295 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:40.872406 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:40.907600 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 0185e826-e937-479b-b6f5-990810f8a591 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:40.907997 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:41.066693 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Pushing event updated for resources: {'Port': ['ID=c7ac200f-e253-44d5-8112-cc54a37d8ba6,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:41.070972 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:41.071872 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3683833', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3816655'] for router_interface, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:41.115835 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed05b610>, [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:37Z', 'revision_number': 3, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:41.119763 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48c2cde6-4c8f-4334-9ff3-207ebdfa3f72 None None] The sync data for ids ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'] in dv-cinder-772623-6-iscsi is: [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:37Z', 'revision_number': 3, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:37:41.209961 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Network 8969d19b-2ae2-4dd6-9861-e28e315bba3f is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:37:41.211011 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:37:41.425124 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:37:41.455709 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-8b246479-5b0e-4d8b-ba64-d2a30caf5275 None None] Provisioning complete for port c7ac200f-e253-44d5-8112-cc54a37d8ba6 triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:41.456208 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-8b246479-5b0e-4d8b-ba64-d2a30caf5275 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:41.512164 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:41.526290 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-8b246479-5b0e-4d8b-ba64-d2a30caf5275 None None] Port c7ac200f-e253-44d5-8112-cc54a37d8ba6 cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:37:41.623915 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:37:41.633351 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] 10.222.0.30 "PUT /v2.0/routers/15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.6728013
May 27 09:37:41.836214 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-38aac953-b8c7-4df2-9e44-2b2e238ba7d8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.158257 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58038) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:42.164081 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-685811052-network', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:37:42.169501 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:37:42.173308 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Usage tracker for resource:network and tenant:9b65b8fc5dc14dcc9f87da1d8841c39c is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:37:42.176158 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:37:42.181840 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:37:42.195193 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Made reservation on behalf of 9b65b8fc5dc14dcc9f87da1d8841c39c for: {'network': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:37:42.197491 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-770877'] for network, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.209318 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.224339 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:37:42.228205 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Usage tracker for resource:security_group_rule and tenant:9b65b8fc5dc14dcc9f87da1d8841c39c is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:37:42.231747 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:37:42.237407 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:37:42.319492 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.323240 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.326798 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1d172e4f-d8da-4038-a50d-40e729b49f59 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:42.359327 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] vlan segment allocate from pool success with {'vlan_id': 399, 'physical_network': 'physnet1'}  {{(pid=91820) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}}
May 27 09:37:42.368652 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64d00832-eb7a-4e85-afcf-eddfa92ac79a,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:42.371951 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:42.376572 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.377426 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.segments_db [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Added segment 4500d488-b8f9-4de4-8844-9685fc72351b of type vlan for network b0ffbf01-8157-4aea-b4fa-61eab4557646
May 27 09:37:42.401581 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.407402 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8739971077196'] for network, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.437085 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819'] for network, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.438150 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:37:42.438734 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.443698 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-541972ea-3ff7-43d7-9b73-e85466dd7810 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:42.541455 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 63e2bf20-0d18-46a4-9d87-4773d39f55c2 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:42.551088 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] 10.222.0.30 "POST /v2.0/networks HTTP/1.1" status: 201  len: 887 time: 0.3917351
May 27 09:37:42.553929 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58042) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:42.554505 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Pushing event updated for resources: {'Network': ['ID=b0ffbf01-8157-4aea-b4fa-61eab4557646,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:42.557596 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:42.560391 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Request body: {'subnet': {'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-685811052-subnet', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'ip_version': 4}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:37:42.565488 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:37:42.569327 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Usage tracker for resource:subnet and tenant:9b65b8fc5dc14dcc9f87da1d8841c39c is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:37:42.573171 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:37:42.579079 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:37:42.584390 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Network b0ffbf01-8157-4aea-b4fa-61eab4557646 details requested by agent ovs-agent-dv-cinder-772623-6-iscsi with host dv-cinder-772623-6-iscsi {{(pid=91822) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}}
May 27 09:37:42.589729 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Made reservation on behalf of 9b65b8fc5dc14dcc9f87da1d8841c39c for: {'subnet': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:37:42.592303 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-2399631'] for subnet, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.698477 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Sync routers for ids ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:37:42.709236 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Routers {'15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:37:42.709873 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd4f4c0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:37:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:42.718390 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 63e2bf20-0d18-46a4-9d87-4773d39f55c2 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:37:42.723606 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 63e2bf20-0d18-46a4-9d87-4773d39f55c2 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:42.723986 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.848124 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.869852 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 63e2bf20-0d18-46a4-9d87-4773d39f55c2, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=63e2bf20-0d18-46a4-9d87-4773d39f55c2,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:37:42.874394 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:42.876542 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:42.900410 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Set router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:37:42.958317 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=63e2bf20-0d18-46a4-9d87-4773d39f55c2,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:42.961654 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:43.118807 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-2157992', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-2399641'] for subnet, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.122503 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:43.202318 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Pushing event updated for resources: {'Subnet': ['ID=fe415665-990d-4bb1-8e4f-012751497c62,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:43.204461 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Checking segment: {'id': '4500d488-b8f9-4de4-8844-9685fc72351b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:37:43.205193 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Network hostable DHCP agents. Network: b0ffbf01-8157-4aea-b4fa-61eab4557646, hostable agents: ['a34bec8e-9adb-4ccb-a422-4cf8946ff9f4'], hosted agents: [] {{(pid=91821) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}}
May 27 09:37:43.208750 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:43.213890 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd4f4c0>, [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 4, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c7ac200f-e253-44d5-8112-cc54a37d8ba6', 'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'mac_address': 'fa:16:3e:21:ef:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:39Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 2, 'project_id': '892895f1788940b1bc09406239590e3f', 'subnets': [{'id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:43.218625 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Checking router: 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:37:43.219027 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Updating router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 port c7ac200f-e253-44d5-8112-cc54a37d8ba6 binding host dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:37:43.223842 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Network b0ffbf01-8157-4aea-b4fa-61eab4557646 is scheduled to be hosted by DHCP agent a34bec8e-9adb-4ccb-a422-4cf8946ff9f4 with binding_index 1 {{(pid=91821) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}}
May 27 09:37:43.233771 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-772623-6-iscsi, b0ffbf01-8157-4aea-b4fa-61eab4557646) {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:37:43.242242 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:37:43.242870 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.244124 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-383b1fd8-0d98-4981-b251-41d924c46043 None None] Network b0ffbf01-8157-4aea-b4fa-61eab4557646 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:37:43.266072 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-48010775-1cc7-4177-97f6-f55abaae5fab admin admin] 10.222.0.30 "POST /v2.0/subnets HTTP/1.1" status: 201  len: 850 time: 0.7086835
May 27 09:37:43.266282 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58046) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:43.272099 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-685811052-router', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:37:43.272274 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.278302 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:37:43.282487 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Usage tracker for resource:router and tenant:9b65b8fc5dc14dcc9f87da1d8841c39c is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:37:43.285411 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:37:43.291400 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:37:43.303355 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-3812772', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-1963'] for router, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.303702 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-3855012', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-3811180', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-3881146', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-1952'] for router, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.320368 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.471541 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp391d76a4-97d4-5c01-84fd-9bc405269bae-b0ffbf01-8157-4aea-b4fa-61eab4557646', 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'fixed_ips': [{'subnet_id': 'fe415665-990d-4bb1-8e4f-012751497c62'}]}} from dv-cinder-772623-6-iscsi. {{(pid=91822) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}}
May 27 09:37:43.473063 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.593318 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-3811195', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-3812794', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2006'] for router, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.625188 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Notify callbacks [] for port, precommit_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.634810 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.db_base_plugin_common [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Allocated IP 172.20.0.2 (b0ffbf01-8157-4aea-b4fa-61eab4557646/fe415665-990d-4bb1-8e4f-012751497c62/dd3592fe-331e-41d5-b35f-add100bd7803) {{(pid=91822) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:37:43.637856 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.provisioning_blocks [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Transition to ACTIVE for port object c7ac200f-e253-44d5-8112-cc54a37d8ba6 will not be triggered until provisioned by entity L2. {{(pid=91823) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:37:43.644837 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.649683 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:43.881188 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Pushing event updated for resources: {'Port': ['ID=c7ac200f-e253-44d5-8112-cc54a37d8ba6,revision_number=3']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:43.889694 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Notify callbacks [] for port, precommit_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.903702 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Transition to ACTIVE for port object dd3592fe-331e-41d5-b35f-add100bd7803 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:37:43.906639 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.906992 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.907332 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.907688 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.908016 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.908343 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.908685 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.909009 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.909378 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.909698 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.910018 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.910330 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91823) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:37:43.916829 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.267s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:43.925397 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Attempting to bind port c7ac200f-e253-44d5-8112-cc54a37d8ba6 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:37:43.925801 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Attempting to bind port c7ac200f-e253-44d5-8112-cc54a37d8ba6 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:37:43.926155 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Attempting to bind port c7ac200f-e253-44d5-8112-cc54a37d8ba6 on network 8969d19b-2ae2-4dd6-9861-e28e315bba3f {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:37:43.927729 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Transition to ACTIVE for port object dd3592fe-331e-41d5-b35f-add100bd7803 will not be triggered until provisioned by entity DHCP. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:37:43.934015 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 37, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:37:43.934543 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Checking segment: {'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91823) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:37:43.935235 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.935822 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Bound using segment: {'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:37:43.935959 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107'] for port, after_create {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.936409 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Bound port: c7ac200f-e253-44d5-8112-cc54a37d8ba6, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'}}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:37:43.936731 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.940805 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:43.942997 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:43.976737 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:44.011688 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Network b0ffbf01-8157-4aea-b4fa-61eab4557646 is already hosted by enough agents. {{(pid=91822) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:37:44.015666 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.scheduler.base_scheduler [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Resources bound (agent type, host, resource id):  {{(pid=91822) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:37:44.017957 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Received port after_create {{(pid=91822) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:37:44.046453 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] For port c7ac200f-e253-44d5-8112-cc54a37d8ba6, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91823) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:37:44.052038 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] For port c7ac200f-e253-44d5-8112-cc54a37d8ba6, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=c7ac200f-e253-44d5-8112-cc54a37d8ba6,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91823) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:37:44.057915 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:44.064669 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:44.069996 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Pushing event updated for resources: {'Port': ['ID=dd3592fe-331e-41d5-b35f-add100bd7803,revision_number=1']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:44.072261 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:44.129838 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Allocated IP 172.27.1.102 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/2678ddcb-0d2c-48f7-be73-6d5978b932b8) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:37:44.141365 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Attempting to bind port dd3592fe-331e-41d5-b35f-add100bd7803 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:37:44.141862 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Attempting to bind port dd3592fe-331e-41d5-b35f-add100bd7803 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '4500d488-b8f9-4de4-8844-9685fc72351b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:37:44.142304 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Attempting to bind port dd3592fe-331e-41d5-b35f-add100bd7803 on network b0ffbf01-8157-4aea-b4fa-61eab4557646 {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:37:44.149018 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 37, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:37:44.149381 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Pushing event updated for resources: {'Port': ['ID=c7ac200f-e253-44d5-8112-cc54a37d8ba6,revision_number=4']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:44.149548 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Checking segment: {'id': '4500d488-b8f9-4de4-8844-9685fc72351b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:37:44.149895 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:44.150361 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Bound using segment: {'id': '4500d488-b8f9-4de4-8844-9685fc72351b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:37:44.150851 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Bound port: dd3592fe-331e-41d5-b35f-add100bd7803, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4500d488-b8f9-4de4-8844-9685fc72351b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:37:44.151317 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:44.155474 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-ed1aac60-06ff-4f7b-b256-7788bb0da40f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:44.157550 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Routers {'15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:37:44.164471 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecd4f4c0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:37:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:44.263895 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] For port dd3592fe-331e-41d5-b35f-add100bd7803, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:37:44.267159 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] For port dd3592fe-331e-41d5-b35f-add100bd7803, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=dd3592fe-331e-41d5-b35f-add100bd7803,segment=NetworkSegment(4500d488-b8f9-4de4-8844-9685fc72351b),segment_id=4500d488-b8f9-4de4-8844-9685fc72351b)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:37:44.273166 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:44.288115 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:44.298229 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:44.336526 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:44.343077 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-9b384837-a4b7-4d84-9c98-48648b3220a0 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:44.371543 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] Set router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:37:44.415423 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:37:44.417643 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:37:44.422050 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:37:44.423491 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Pushing event updated for resources: {'Port': ['ID=dd3592fe-331e-41d5-b35f-add100bd7803,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:44.427344 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-d6e0c30f-b36f-4086-8bc6-efc7f54d8969 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:44.466836 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Pushing event updated for resources: {'Port': ['ID=2678ddcb-0d2c-48f7-be73-6d5978b932b8,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:44.473302 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:44.530654 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 63e2bf20-0d18-46a4-9d87-4773d39f55c2 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:44.647554 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 63e2bf20-0d18-46a4-9d87-4773d39f55c2 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:44.648301 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:44.778486 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecd4f4c0>, [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 4, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c7ac200f-e253-44d5-8112-cc54a37d8ba6', 'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'mac_address': 'fa:16:3e:21:ef:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:39Z', 'updated_at': '2021-05-27T09:37:44Z', 'revision_number': 4, 'project_id': '892895f1788940b1bc09406239590e3f', 'subnets': [{'id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:44.783190 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf6af7ce-5ce5-410b-92f8-7b766088c7ef None None] The sync data for ids ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'] in dv-cinder-772623-6-iscsi is: [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 4, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c7ac200f-e253-44d5-8112-cc54a37d8ba6', 'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'mac_address': 'fa:16:3e:21:ef:c0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:39Z', 'updated_at': '2021-05-27T09:37:44Z', 'revision_number': 4, 'project_id': '892895f1788940b1bc09406239590e3f', 'subnets': [{'id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:37:44.943925 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:45.051865 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:45.425191 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-3812787', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-3811082'] for router, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:45.465754 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-965a5e49-13ca-474f-842d-25004d42b645 None None] Network b0ffbf01-8157-4aea-b4fa-61eab4557646 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:37:45.582785 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-bb713da7-b916-45fb-8680-6f33d16aefad None None] Provisioning for port dd3592fe-331e-41d5-b35f-add100bd7803 completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:37:45.675928 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Router c53aa6c2-27af-4d14-85b8-2c147223e99f is scheduled to L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 with binding_index 1 {{(pid=91821) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}}
May 27 09:37:45.875234 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:37:45.884896 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Sync routers for ids ['c53aa6c2-27af-4d14-85b8-2c147223e99f'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:37:45.895528 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Routers {'c53aa6c2-27af-4d14-85b8-2c147223e99f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:37:45.896199 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec6d8fa0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:37:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['c53aa6c2-27af-4d14-85b8-2c147223e99f'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:45.907138 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] Notify callbacks [] for router, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:45.911416 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-5f605c2b-b24b-4e1b-9123-65ef0c1c2666 admin admin] 10.222.0.30 "POST /v2.0/routers HTTP/1.1" status: 201  len: 926 time: 2.6414971
May 27 09:37:45.911893 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58050) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:37:46.092988 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Set router c53aa6c2-27af-4d14-85b8-2c147223e99f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:37:46.381664 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec6d8fa0>, [{'id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'name': 'tempest-TestMinimumBasicScenario-685811052-router', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:43Z', 'updated_at': '2021-05-27T09:37:44Z', 'revision_number': 3, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'gw_port': {'id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ec:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:44Z', 'updated_at': '2021-05-27T09:37:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:46.385593 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Checking router: c53aa6c2-27af-4d14-85b8-2c147223e99f for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:37:46.385961 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Updating router c53aa6c2-27af-4d14-85b8-2c147223e99f port 2678ddcb-0d2c-48f7-be73-6d5978b932b8 binding host dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:37:46.448448 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:46.600176 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device c7ac200f-e253-44d5-8112-cc54a37d8ba6 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:46.729576 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:46.769788 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port c7ac200f-e253-44d5-8112-cc54a37d8ba6 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:37:46.779079 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port c7ac200f-e253-44d5-8112-cc54a37d8ba6 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:46.779485 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:46.940046 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Allocated IP 172.20.0.1 (b0ffbf01-8157-4aea-b4fa-61eab4557646/fe415665-990d-4bb1-8e4f-012751497c62/dd39c62e-c9b7-41c2-8a70-065090c50c6d) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:37:46.982782 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Notify callbacks [] for port, precommit_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.018201 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Transition to ACTIVE for port object 2678ddcb-0d2c-48f7-be73-6d5978b932b8 will not be triggered until provisioned by entity L2. {{(pid=91822) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:37:47.030473 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.041326 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.048293 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:47.103718 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.120491 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Transition to ACTIVE for port object dd39c62e-c9b7-41c2-8a70-065090c50c6d will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:37:47.141999 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Attempting to bind port 2678ddcb-0d2c-48f7-be73-6d5978b932b8 on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:37:47.142633 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Attempting to bind port 2678ddcb-0d2c-48f7-be73-6d5978b932b8 by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:37:47.142847 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Attempting to bind port 2678ddcb-0d2c-48f7-be73-6d5978b932b8 on network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:37:47.144556 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.145976 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port c7ac200f-e253-44d5-8112-cc54a37d8ba6, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=c7ac200f-e253-44d5-8112-cc54a37d8ba6,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:37:47.148753 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-852e1364-110b-4900-af94-cba69b5f92b3 None None] Pushing event updated for resources: {'Port': ['ID=2678ddcb-0d2c-48f7-be73-6d5978b932b8,revision_number=2']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:47.149123 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3ec76e11-9461-4698-89f5-c7109fd96914 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:47.154646 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-852e1364-110b-4900-af94-cba69b5f92b3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:47.155472 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 37, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:37:47.155989 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Checking segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91822) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:37:47.156401 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.156798 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Bound using segment: {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'} {{(pid=91822) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:37:47.157274 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.managers [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Bound port: 2678ddcb-0d2c-48f7-be73-6d5978b932b8, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c9d11f8e-7743-4d8a-b53e-c5e082b29e82', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae'}}] {{(pid=91822) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:37:47.157679 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.181179 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.182015 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device dd3592fe-331e-41d5-b35f-add100bd7803 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:47.213094 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:47.217721 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Network b0ffbf01-8157-4aea-b4fa-61eab4557646 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:37:47.220682 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:37:47.224656 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:37:47.256325 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Pushing event updated for resources: {'Port': ['ID=dd39c62e-c9b7-41c2-8a70-065090c50c6d,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:47.263675 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:47.291142 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-3816556'] for router_interface, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.334470 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=c7ac200f-e253-44d5-8112-cc54a37d8ba6,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:47.341025 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:47.352460 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] For port 2678ddcb-0d2c-48f7-be73-6d5978b932b8, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91822) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:37:47.356241 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] For port 2678ddcb-0d2c-48f7-be73-6d5978b932b8, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=2678ddcb-0d2c-48f7-be73-6d5978b932b8,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:37:47.360192 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port dd3592fe-331e-41d5-b35f-add100bd7803 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:37:47.365242 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.369388 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:47.407308 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port dd3592fe-331e-41d5-b35f-add100bd7803 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:47.407717 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.423411 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.501636 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Routers {'c53aa6c2-27af-4d14-85b8-2c147223e99f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:37:47.502169 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec6d8fa0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:37:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['c53aa6c2-27af-4d14-85b8-2c147223e99f'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:47.552147 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-852e1364-110b-4900-af94-cba69b5f92b3 None None] Pushing event updated for resources: {'Port': ['ID=2678ddcb-0d2c-48f7-be73-6d5978b932b8,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:47.562184 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-852e1364-110b-4900-af94-cba69b5f92b3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:47.626826 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-2e962871-2a64-4dde-9874-af74670c595f None None] Provisioning for port dd39c62e-c9b7-41c2-8a70-065090c50c6d completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:37:47.659536 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.664155 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.693191 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0d5c6032-8ad4-4263-9313-b22cc2744aee admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:47.702524 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-2e962871-2a64-4dde-9874-af74670c595f None None] Provisioning complete for port dd39c62e-c9b7-41c2-8a70-065090c50c6d triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:47.702902 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-2e962871-2a64-4dde-9874-af74670c595f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.771496 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.778468 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-3683833', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-3816655'] for router_interface, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.781850 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Pushing event updated for resources: {'Port': ['ID=dd39c62e-c9b7-41c2-8a70-065090c50c6d,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:47.784739 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:47.802387 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-2e962871-2a64-4dde-9874-af74670c595f None None] Port dd39c62e-c9b7-41c2-8a70-065090c50c6d cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:37:47.821283 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] Set router c53aa6c2-27af-4d14-85b8-2c147223e99f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:37:47.882970 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port dd3592fe-331e-41d5-b35f-add100bd7803, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=dd3592fe-331e-41d5-b35f-add100bd7803,segment=NetworkSegment(4500d488-b8f9-4de4-8844-9685fc72351b),segment_id=4500d488-b8f9-4de4-8844-9685fc72351b)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:37:47.889675 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:47.893280 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-09205d1f-262b-4458-ad98-5fbb5699b95f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:47.926072 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Network b0ffbf01-8157-4aea-b4fa-61eab4557646 is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:37:47.927277 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:37:48.096143 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=dd3592fe-331e-41d5-b35f-add100bd7803,revision_number=3']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:48.100784 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:48.130225 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Router c53aa6c2-27af-4d14-85b8-2c147223e99f has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:37:48.208834 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec6d8fa0>, [{'id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'name': 'tempest-TestMinimumBasicScenario-685811052-router', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:43Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 4, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'gw_port': {'id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ec:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:44Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'dd39c62e-c9b7-41c2-8a70-065090c50c6d', 'name': '', 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'mac_address': 'fa:16:3e:4d:4f:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'fe415665-990d-4bb1-8e4f-012751497c62', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:46Z', 'updated_at': '2021-05-27T09:37:46Z', 'revision_number': 1, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'subnets': [{'id': 'fe415665-990d-4bb1-8e4f-012751497c62', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:48.217112 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94f75e91-f3b7-483f-83ce-d44039d1421a None None] The sync data for ids ['c53aa6c2-27af-4d14-85b8-2c147223e99f'] in dv-cinder-772623-6-iscsi is: [{'id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'name': 'tempest-TestMinimumBasicScenario-685811052-router', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:43Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 4, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'gw_port': {'id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ec:88', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:44Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'dd39c62e-c9b7-41c2-8a70-065090c50c6d', 'name': '', 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'mac_address': 'fa:16:3e:4d:4f:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'fe415665-990d-4bb1-8e4f-012751497c62', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:46Z', 'updated_at': '2021-05-27T09:37:46Z', 'revision_number': 1, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'subnets': [{'id': 'fe415665-990d-4bb1-8e4f-012751497c62', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:37:48.228995 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-c3731f93-7951-4958-9347-e39309e90e7a None None] Provisioning complete for port dd39c62e-c9b7-41c2-8a70-065090c50c6d triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:48.229639 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-c3731f93-7951-4958-9347-e39309e90e7a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:48.287190 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-c3731f93-7951-4958-9347-e39309e90e7a None None] Port dd39c62e-c9b7-41c2-8a70-065090c50c6d cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:37:48.469167 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:37:48.478625 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-53cadc46-c7ba-40c7-b168-2392b7bb433a admin admin] 10.222.0.30 "PUT /v2.0/routers/c53aa6c2-27af-4d14-85b8-2c147223e99f/add_router_interface HTTP/1.1" status: 200  len: 503 time: 2.5655386
May 27 09:37:48.544254 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device c7ac200f-e253-44d5-8112-cc54a37d8ba6 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:48.626587 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port c7ac200f-e253-44d5-8112-cc54a37d8ba6 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:48.626980 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:48.806879 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device dd3592fe-331e-41d5-b35f-add100bd7803 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:48.885911 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port dd3592fe-331e-41d5-b35f-add100bd7803 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:48.886292 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:50.567562 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 2678ddcb-0d2c-48f7-be73-6d5978b932b8 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:50.647483 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port 2678ddcb-0d2c-48f7-be73-6d5978b932b8 completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:37:50.653386 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 2678ddcb-0d2c-48f7-be73-6d5978b932b8 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:50.653783 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:50.786244 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:50.805393 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port 2678ddcb-0d2c-48f7-be73-6d5978b932b8, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=2678ddcb-0d2c-48f7-be73-6d5978b932b8,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:37:50.810216 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:50.813141 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:50.892987 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=2678ddcb-0d2c-48f7-be73-6d5978b932b8,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:50.903670 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:52.031297 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Sync routers for ids ['c53aa6c2-27af-4d14-85b8-2c147223e99f'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:37:52.043889 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Routers {'c53aa6c2-27af-4d14-85b8-2c147223e99f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:37:52.044799 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed08eee0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:37:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['c53aa6c2-27af-4d14-85b8-2c147223e99f'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:52.238670 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Set router c53aa6c2-27af-4d14-85b8-2c147223e99f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:37:52.540984 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 2678ddcb-0d2c-48f7-be73-6d5978b932b8 up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:52.619468 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port 2678ddcb-0d2c-48f7-be73-6d5978b932b8 triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:52.619678 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:52.627903 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed08eee0>, [{'id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'name': 'tempest-TestMinimumBasicScenario-685811052-router', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:43Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 4, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'gw_port': {'id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ec:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:44Z', 'updated_at': '2021-05-27T09:37:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'dd39c62e-c9b7-41c2-8a70-065090c50c6d', 'name': '', 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'mac_address': 'fa:16:3e:4d:4f:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'fe415665-990d-4bb1-8e4f-012751497c62', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:46Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 2, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'subnets': [{'id': 'fe415665-990d-4bb1-8e4f-012751497c62', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:52.632868 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Checking router: c53aa6c2-27af-4d14-85b8-2c147223e99f for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:37:52.633493 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Updating router c53aa6c2-27af-4d14-85b8-2c147223e99f port dd39c62e-c9b7-41c2-8a70-065090c50c6d binding host dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}}
May 27 09:37:52.692457 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:53.064390 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Notify callbacks [] for port, precommit_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:53.077749 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.provisioning_blocks [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Transition to ACTIVE for port object dd39c62e-c9b7-41c2-8a70-065090c50c6d will not be triggered until provisioned by entity L2. {{(pid=91823) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:37:53.085806 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:53.090732 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-923bf1df-6ea3-4a8c-baf3-5616bdf6e50e None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:53.315570 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-071b2173-f4e0-4e25-a6fb-4d0249ef25c7 None None] Pushing event updated for resources: {'Port': ['ID=dd39c62e-c9b7-41c2-8a70-065090c50c6d,revision_number=3']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:53.319683 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-071b2173-f4e0-4e25-a6fb-4d0249ef25c7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.229s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:53.328584 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Attempting to bind port dd39c62e-c9b7-41c2-8a70-065090c50c6d on host dv-cinder-772623-6-iscsi for vnic_type normal with profile  {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:37:53.328953 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Attempting to bind port dd39c62e-c9b7-41c2-8a70-065090c50c6d by drivers openvswitch,hyperv on host dv-cinder-772623-6-iscsi at level 0 using segments [{'id': '4500d488-b8f9-4de4-8844-9685fc72351b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646'}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:37:53.329314 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Attempting to bind port dd39c62e-c9b7-41c2-8a70-065090c50c6d on network b0ffbf01-8157-4aea-b4fa-61eab4557646 {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:37:53.335689 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Checking agent: {'id': 'e5cf0dd9-e408-4679-aa86-1795a78a4e7d', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-772623-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 19, 11), 'started_at': datetime.datetime(2021, 5, 27, 9, 19, 41), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 37, 41), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-772623-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:37:53.336416 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Checking segment: {'id': '4500d488-b8f9-4de4-8844-9685fc72351b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91823) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:37:53.337184 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:53.337589 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Bound using segment: {'id': '4500d488-b8f9-4de4-8844-9685fc72351b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646'} {{(pid=91823) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:37:53.338071 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.managers [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Bound port: dd39c62e-c9b7-41c2-8a70-065090c50c6d, host: dv-cinder-772623-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4500d488-b8f9-4de4-8844-9685fc72351b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 399, 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646'}}] {{(pid=91823) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:37:53.338453 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:53.445568 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] For port dd39c62e-c9b7-41c2-8a70-065090c50c6d, host dv-cinder-772623-6-iscsi, cleared binding levels {{(pid=91823) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:37:53.450053 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.plugins.ml2.db [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] For port dd39c62e-c9b7-41c2-8a70-065090c50c6d, host dv-cinder-772623-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=dd39c62e-c9b7-41c2-8a70-065090c50c6d,segment=NetworkSegment(4500d488-b8f9-4de4-8844-9685fc72351b),segment_id=4500d488-b8f9-4de4-8844-9685fc72351b)] {{(pid=91823) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:37:53.456338 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron_lib.callbacks.manager [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91823) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:53.460453 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-873818d7-c976-4f0d-9786-94059ebcc2c7 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:53.543665 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Routers {'c53aa6c2-27af-4d14-85b8-2c147223e99f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:37:53.544303 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed08eee0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:37:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['c53aa6c2-27af-4d14-85b8-2c147223e99f'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:53.598075 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-071b2173-f4e0-4e25-a6fb-4d0249ef25c7 None None] Pushing event updated for resources: {'Port': ['ID=dd39c62e-c9b7-41c2-8a70-065090c50c6d,revision_number=4']} {{(pid=91823) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:53.608857 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG oslo_concurrency.lockutils [None req-071b2173-f4e0-4e25-a6fb-4d0249ef25c7 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.148s {{(pid=91823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:53.755615 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] Set router c53aa6c2-27af-4d14-85b8-2c147223e99f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:37:54.098668 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed08eee0>, [{'id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'name': 'tempest-TestMinimumBasicScenario-685811052-router', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:43Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 4, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'gw_port': {'id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ec:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:44Z', 'updated_at': '2021-05-27T09:37:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'dd39c62e-c9b7-41c2-8a70-065090c50c6d', 'name': '', 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'mac_address': 'fa:16:3e:4d:4f:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'fe415665-990d-4bb1-8e4f-012751497c62', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:46Z', 'updated_at': '2021-05-27T09:37:53Z', 'revision_number': 4, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'subnets': [{'id': 'fe415665-990d-4bb1-8e4f-012751497c62', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:37:54.105707 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cc272b6-3161-4637-ac2e-e0faf80d9ea8 None None] The sync data for ids ['c53aa6c2-27af-4d14-85b8-2c147223e99f'] in dv-cinder-772623-6-iscsi is: [{'id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'name': 'tempest-TestMinimumBasicScenario-685811052-router', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:43Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 4, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'gw_port': {'id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ec:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:44Z', 'updated_at': '2021-05-27T09:37:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'dd39c62e-c9b7-41c2-8a70-065090c50c6d', 'name': '', 'network_id': 'b0ffbf01-8157-4aea-b4fa-61eab4557646', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'mac_address': 'fa:16:3e:4d:4f:0d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_interface', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': 'fe415665-990d-4bb1-8e4f-012751497c62', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:46Z', 'updated_at': '2021-05-27T09:37:53Z', 'revision_number': 4, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'subnets': [{'id': 'fe415665-990d-4bb1-8e4f-012751497c62', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:37:54.550306 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device dd39c62e-c9b7-41c2-8a70-065090c50c6d up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:54.660339 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning for port dd39c62e-c9b7-41c2-8a70-065090c50c6d completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:37:54.665712 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port dd39c62e-c9b7-41c2-8a70-065090c50c6d triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:54.666092 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:54.810332 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:54.844863 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] For port dd39c62e-c9b7-41c2-8a70-065090c50c6d, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=dd39c62e-c9b7-41c2-8a70-065090c50c6d,segment=NetworkSegment(4500d488-b8f9-4de4-8844-9685fc72351b),segment_id=4500d488-b8f9-4de4-8844-9685fc72351b)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:37:54.849137 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:54.850933 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:37:54.925754 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Pushing event updated for resources: {'Port': ['ID=dd39c62e-c9b7-41c2-8a70-065090c50c6d,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:37:54.929869 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:37:56.477745 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:56.546128 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device dd39c62e-c9b7-41c2-8a70-065090c50c6d up at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:37:56.627502 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Provisioning complete for port dd39c62e-c9b7-41c2-8a70-065090c50c6d triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:37:56.628183 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:37:58.629440 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-bf902997-b4ac-49b0-926e-a03cab21826f tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:37:58.630118 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-bf902997-b4ac-49b0-926e-a03cab21826f tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Synchronizing usage tracker for tenant:892895f1788940b1bc09406239590e3f on resource:network {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:37:58.645814 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-bf902997-b4ac-49b0-926e-a03cab21826f tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Unset dirty status for tenant:892895f1788940b1bc09406239590e3f on resource:network {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:37:58.646992 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-bf902997-b4ac-49b0-926e-a03cab21826f tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/networks?id=8969d19b-2ae2-4dd6-9861-e28e315bba3f HTTP/1.1" status: 200  len: 814 time: 0.1604409
May 27 09:37:58.662987 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-01232e8a-a878-48ef-941d-2daa7ea11a2d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/quotas/892895f1788940b1bc09406239590e3f HTTP/1.1" status: 200  len: 375 time: 0.0098987
May 27 09:37:58.745976 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b57a897a-9f26-4944-b2f0-11e2d1f56e8c tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=892895f1788940b1bc09406239590e3f&fields=id HTTP/1.1" status: 200  len: 302 time: 0.0770802
May 27 09:37:58.857322 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-c2e2347a-8f45-4ccd-a150-e2fa0d1567f9 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91821) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:37:58.858319 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-c2e2347a-8f45-4ccd-a150-e2fa0d1567f9 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.1010563
May 27 09:37:59.095564 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-54c276cc-4d69-4169-b2b8-35aca8a75675 service neutron] 10.222.0.30 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.2314470
May 27 09:37:59.226944 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-9430bcb5-c9f3-4fa2-a79c-1f9af5a7e481 service neutron] 10.222.0.30 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1252759
May 27 09:37:59.452626 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-112feb38-6fc8-4b9b-b235-cd5694bddcf5 req-38cc91c7-1450-4a39-99c6-7a382498a4d7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 210 time: 0.0910552
May 27 09:38:00.616658 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b96bdd3d-cfb3-4c17-ba86-a47ae51a9e7c req-dfbf9032-0925-49e0-9a2d-848f1f40c04f tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 210 time: 0.0538456
May 27 09:38:00.623666 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-31f00761-27d1-4224-b3f6-83161512091e tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:00.625203 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-31f00761-27d1-4224-b3f6-83161512091e tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.11 "GET /v2.0/networks?id=8969d19b-2ae2-4dd6-9861-e28e315bba3f HTTP/1.1" status: 200  len: 814 time: 0.1637731
May 27 09:38:00.638470 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Request body: {'port': {'device_id': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'admin_state_up': True, 'tenant_id': '892895f1788940b1bc09406239590e3f'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:00.781023 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:00.784817 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Usage tracker for resource:port and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:38:00.787634 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Quota usage for port was recalculated. Used quota:2. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:38:00.793847 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:00.804633 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Made reservation on behalf of 892895f1788940b1bc09406239590e3f for: {'port': 1} {{(pid=91820) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:38:00.808300 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:00.987981 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Allocated IP 172.20.0.11 (8969d19b-2ae2-4dd6-9861-e28e315bba3f/c1677eac-45e9-4a22-9a63-044a5ded43ac/d9fbaf8a-ddda-4038-b9c9-3c246b80818a) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:38:01.258232 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:01.274749 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Transition to ACTIVE for port object d9fbaf8a-ddda-4038-b9c9-3c246b80818a will not be triggered until provisioned by entity DHCP. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:38:01.299748 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:01.305661 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2816c6d0-2738-4b88-a4eb-ffb958eafd8c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:01.377440 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Network 8969d19b-2ae2-4dd6-9861-e28e315bba3f is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:38:01.380706 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:38:01.384670 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:38:01.416107 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'Port': ['ID=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:01.423454 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:01.455453 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:01.456110 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:01.485584 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.8517694
May 27 09:38:01.676272 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-529d354a-36c6-44c0-9584-cd747d5edfa3 None None] Provisioning for port d9fbaf8a-ddda-4038-b9c9-3c246b80818a completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:38:01.681601 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-529d354a-36c6-44c0-9584-cd747d5edfa3 None None] Provisioning complete for port d9fbaf8a-ddda-4038-b9c9-3c246b80818a triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:38:01.682303 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-529d354a-36c6-44c0-9584-cd747d5edfa3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:01.740379 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-529d354a-36c6-44c0-9584-cd747d5edfa3 None None] Port d9fbaf8a-ddda-4038-b9c9-3c246b80818a cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:38:01.832497 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4092c0fc-04e2-4879-9138-3017bdad341f req-06a1482d-1c4d-4b7d-bfcd-f70ea0dd81e1 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:01.834112 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4092c0fc-04e2-4879-9138-3017bdad341f req-06a1482d-1c4d-4b7d-bfcd-f70ea0dd81e1 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 932 time: 0.0897624
May 27 09:38:01.886915 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-4092c0fc-04e2-4879-9138-3017bdad341f req-e1864a71-18fe-4689-b55e-04569d491b5f tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Synchronizing usage tracker for tenant:892895f1788940b1bc09406239590e3f on resource:security_group {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:38:01.903642 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-4092c0fc-04e2-4879-9138-3017bdad341f req-e1864a71-18fe-4689-b55e-04569d491b5f tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Unset dirty status for tenant:892895f1788940b1bc09406239590e3f on resource:security_group {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:38:01.904773 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4092c0fc-04e2-4879-9138-3017bdad341f req-e1864a71-18fe-4689-b55e-04569d491b5f tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0638361
May 27 09:38:02.104726 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:38:03.095483 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e15607c-33b1-44c5-8b6a-4f5a0b8ee8f5 req-a5140885-7d01-4451-a4df-78fb19dce760 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:03.097161 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0e15607c-33b1-44c5-8b6a-4f5a0b8ee8f5 req-a5140885-7d01-4451-a4df-78fb19dce760 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 932 time: 0.0831468
May 27 09:38:03.149897 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0e15607c-33b1-44c5-8b6a-4f5a0b8ee8f5 req-1fd5cf21-bef8-40b9-97ea-634e934cbd01 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0454676
May 27 09:38:04.352031 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc2a9da-e198-4df2-ae06-351ba715554f req-932ba37e-6397-4927-9625-27c244517b35 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:04.353559 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2fc2a9da-e198-4df2-ae06-351ba715554f req-932ba37e-6397-4927-9625-27c244517b35 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 932 time: 0.0932457
May 27 09:38:04.400959 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-2fc2a9da-e198-4df2-ae06-351ba715554f req-b5d55462-a6f9-47bb-bc0c-65f93465fa03 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0412450
May 27 09:38:05.601808 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e319afc7-596f-4605-a4a8-f6a97e6b5abd req-83a8988e-ba42-4e1f-8efb-53901652cdb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:05.603283 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e319afc7-596f-4605-a4a8-f6a97e6b5abd req-83a8988e-ba42-4e1f-8efb-53901652cdb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 932 time: 0.0833392
May 27 09:38:05.655935 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e319afc7-596f-4605-a4a8-f6a97e6b5abd req-d224b321-8372-4778-9612-4730a55931d3 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0469482
May 27 09:38:06.868278 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f57875e-8033-4c4c-969f-f7b8dc09fa1c req-2a24aae6-28cd-4ee1-ae2c-adf26b148311 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:06.869833 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3f57875e-8033-4c4c-969f-f7b8dc09fa1c req-2a24aae6-28cd-4ee1-ae2c-adf26b148311 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 932 time: 0.1046073
May 27 09:38:06.930765 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3f57875e-8033-4c4c-969f-f7b8dc09fa1c req-fda98d72-0934-45d5-8bd1-a5dbebc60ef6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0542300
May 27 09:38:08.122304 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f968006d-4e9c-4c48-86c8-2c988eace047 req-b0e9c15a-b68c-4fa3-bdbb-1d31603baa1c tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:08.123982 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f968006d-4e9c-4c48-86c8-2c988eace047 req-b0e9c15a-b68c-4fa3-bdbb-1d31603baa1c tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 932 time: 0.0939915
May 27 09:38:08.174523 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f968006d-4e9c-4c48-86c8-2c988eace047 req-393e7025-8abb-4108-9b84-06ae1f8591a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0442097
May 27 09:38:08.526418 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-0fa91268-1530-4c0b-aca8-69b876395df1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:09.380595 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-284ebdbd-98fa-4935-8d2b-be0c9876acbc req-4eda3379-774f-47ca-9ec4-dcff2b372e7a tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:09.382153 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-284ebdbd-98fa-4935-8d2b-be0c9876acbc req-4eda3379-774f-47ca-9ec4-dcff2b372e7a tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 932 time: 0.0898268
May 27 09:38:09.437538 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-284ebdbd-98fa-4935-8d2b-be0c9876acbc req-a0fc4792-709e-49b6-986a-fa8c77696fd5 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0498309
May 27 09:38:10.642671 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f90e95-5881-489d-9eaa-ccabc72b6a1e req-2706d14e-49e5-42f6-8079-8fa61a71dc11 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:10.644202 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d2f90e95-5881-489d-9eaa-ccabc72b6a1e req-2706d14e-49e5-42f6-8079-8fa61a71dc11 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 932 time: 0.0927916
May 27 09:38:10.691543 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d2f90e95-5881-489d-9eaa-ccabc72b6a1e req-b7605a4c-13e1-44dc-ad91-cd44d256f985 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0416191
May 27 09:38:11.357531 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-9c05384d-5b24-4714-bc26-a2d971984911 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1951300864&fields=id&tenant_id=b8df97a650014930beb6e52081be8e90 HTTP/1.1" status: 200  len: 267 time: 0.0400858
May 27 09:38:11.432969 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Request body: {'port': {'device_id': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:11.466730 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:11.511726 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-0eb62f83-1bd0-47ed-a1fa-281acf8e39af tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:11.513188 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-0eb62f83-1bd0-47ed-a1fa-281acf8e39af tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 811 time: 0.1485779
May 27 09:38:11.528271 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-097034d6-210d-40ca-b33c-5e6719580b22 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/quotas/b8df97a650014930beb6e52081be8e90 HTTP/1.1" status: 200  len: 375 time: 0.0091550
May 27 09:38:11.555970 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:11.622177 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-38084792-7a1d-4705-ad7c-4ac544397c9b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&fields=id HTTP/1.1" status: 200  len: 440 time: 0.0881453
May 27 09:38:11.639052 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-235af3c9-61ac-4965-b5fa-de3ee1a2b635 service neutron] http://10.222.0.30:9696/v2.0/extensions returned with HTTP 200 {{(pid=91821) __call__ /opt/stack/neutron/neutron/wsgi.py:729}}
May 27 09:38:11.640566 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-235af3c9-61ac-4965-b5fa-de3ee1a2b635 service neutron] 10.222.0.30 "GET /v2.0/extensions HTTP/1.1" status: 200  len: 13640 time: 0.0067060
May 27 09:38:11.776250 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-788ef8e7-24fc-4307-9592-de421fac7078 service neutron] 10.222.0.30 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1296682
May 27 09:38:11.829762 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ca9907b-5895-422e-99ec-fcb521fad00e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:11.910554 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d9fbaf8a-ddda-4038-b9c9-3c246b80818a {{(pid=91820) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:38:11.918515 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:11.936912 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.provisioning_blocks [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Transition to ACTIVE for port object d9fbaf8a-ddda-4038-b9c9-3c246b80818a will not be triggered until provisioned by entity L2. {{(pid=91820) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:38:11.940865 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:11.944859 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5f930f24-2815-4418-929e-5c2dae9478b2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:12.063127 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-5ad270a3-dc99-42d7-a0fa-59eb91a972d5 service neutron] 10.222.0.30 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2802007
May 27 09:38:12.075896 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2520b5a-eb76-4617-a94e-4e94e82956f4 req-46c63211-48b8-4f8d-9a1e-c2edf72cb8fb tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:12.078021 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a2520b5a-eb76-4617-a94e-4e94e82956f4 req-46c63211-48b8-4f8d-9a1e-c2edf72cb8fb tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 944 time: 0.2712436
May 27 09:38:12.117604 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Pushing event updated for resources: {'Port': ['ID=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:12.127661 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a2520b5a-eb76-4617-a94e-4e94e82956f4 req-207e3832-511f-48ee-85fc-81a4f2b7eaf8 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0440488
May 27 09:38:12.152714 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.208s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:12.201652 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Attempting to bind port d9fbaf8a-ddda-4038-b9c9-3c246b80818a on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:38:12.202699 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Attempting to bind port d9fbaf8a-ddda-4038-b9c9-3c246b80818a by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:38:12.203240 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Attempting to bind port d9fbaf8a-ddda-4038-b9c9-3c246b80818a on network 8969d19b-2ae2-4dd6-9861-e28e315bba3f {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:38:12.209278 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Port d9fbaf8a-ddda-4038-b9c9-3c246b80818a on network 8969d19b-2ae2-4dd6-9861-e28e315bba3f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:38:12.209612 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Attempting to bind port d9fbaf8a-ddda-4038-b9c9-3c246b80818a on network 8969d19b-2ae2-4dd6-9861-e28e315bba3f {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:38:12.215569 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 37, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:38:12.215882 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Checking segment: {'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91820) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:38:12.216344 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Bound using segment: {'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'} {{(pid=91820) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:38:12.216717 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.managers [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Bound port: d9fbaf8a-ddda-4038-b9c9-3c246b80818a, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 398, 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f'}}] {{(pid=91820) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:38:12.217123 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:12.321648 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] For port d9fbaf8a-ddda-4038-b9c9-3c246b80818a, host hv-cinder-77262, cleared binding levels {{(pid=91820) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:38:12.325164 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] For port d9fbaf8a-ddda-4038-b9c9-3c246b80818a, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91820) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:38:12.329853 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:12.334225 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-516b66da-9049-47ce-8c97-9fe8809fc29d tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:12.385274 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:12.386260 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:12.387770 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] 10.222.0.11 "PUT /v2.0/ports/d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 200  len: 1094 time: 0.9693074
May 27 09:38:12.396431 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:38:12.410215 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:12.428868 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Pushing event updated for resources: {'Port': ['ID=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,revision_number=3']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:12.432599 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:12.528612 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-8602f7ef-f36b-4bb3-84e3-de06fcbc916c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:12.531529 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-8602f7ef-f36b-4bb3-84e3-de06fcbc916c service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=892895f1788940b1bc09406239590e3f&device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 1097 time: 0.0892506
May 27 09:38:12.586074 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f1b71800-a3d5-44a7-b488-6ac01f673406 req-71bf4f0f-4d72-4367-b60a-0d2e5c7ee0f4 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 210 time: 0.0567570
May 27 09:38:12.719975 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'status': 'completed', 'code': 200}
May 27 09:38:12.735321 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-fd916af6-53a4-4190-8cdb-0b95bf33f1db service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 200  len: 217 time: 0.1970031
May 27 09:38:12.814726 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-19aa8751-f0bc-444d-b7bc-de5f79174de3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:12.816228 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-19aa8751-f0bc-444d-b7bc-de5f79174de3 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c1677eac-45e9-4a22-9a63-044a5ded43ac HTTP/1.1" status: 200  len: 853 time: 0.0651047
May 27 09:38:12.899345 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-0eb2b93b-e9ae-4c9f-be63-e37a7b5eb053 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:12.901064 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-0eb2b93b-e9ae-4c9f-be63-e37a7b5eb053 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=8969d19b-2ae2-4dd6-9861-e28e315bba3f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0774632
May 27 09:38:13.035145 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-0f84a3b4-008b-4833-b40c-d07605fc53f4 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1269767
May 27 09:38:13.174749 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-69b74d9d-f3ce-4865-b6e5-49338052d8e3 req-18479d8c-b5f2-44ca-b25e-22aa8003bca8 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1331525
May 27 09:38:13.287888 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e2fa916-28f9-419e-b31b-5997b84c9221 req-b3f85219-1228-4f70-8d13-cf5605f6a553 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:13.289388 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5e2fa916-28f9-419e-b31b-5997b84c9221 req-b3f85219-1228-4f70-8d13-cf5605f6a553 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=892895f1788940b1bc09406239590e3f&device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 1097 time: 0.0705333
May 27 09:38:13.323827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0720091a-1c06-436a-b2ae-53aeadd83405 req-f93c7c78-e5eb-41fb-be71-48d1bcb7f1fc tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:13.325308 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0720091a-1c06-436a-b2ae-53aeadd83405 req-f93c7c78-e5eb-41fb-be71-48d1bcb7f1fc tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 944 time: 0.0878055
May 27 09:38:13.372644 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-0720091a-1c06-436a-b2ae-53aeadd83405 req-fdf98cc2-530d-4dac-979a-7d7b2977f254 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0405490
May 27 09:38:13.425140 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e2fa916-28f9-419e-b31b-5997b84c9221 req-74333f34-30c4-4059-8184-6236afa5bb93 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:13.426621 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5e2fa916-28f9-419e-b31b-5997b84c9221 req-74333f34-30c4-4059-8184-6236afa5bb93 service neutron] 10.222.0.11 "GET /v2.0/networks?id=8969d19b-2ae2-4dd6-9861-e28e315bba3f HTTP/1.1" status: 200  len: 915 time: 0.1305928
May 27 09:38:13.501484 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5e2fa916-28f9-419e-b31b-5997b84c9221 req-85d04e17-a4d2-4718-939d-cb75097a2939 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 200  len: 217 time: 0.0680034
May 27 09:38:13.579510 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e2fa916-28f9-419e-b31b-5997b84c9221 req-ced8a507-8fea-4f49-a608-41aa750dab81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:13.580993 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5e2fa916-28f9-419e-b31b-5997b84c9221 req-ced8a507-8fea-4f49-a608-41aa750dab81 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c1677eac-45e9-4a22-9a63-044a5ded43ac HTTP/1.1" status: 200  len: 853 time: 0.0643382
May 27 09:38:13.661495 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-b89a9fcc-2d81-47fa-b773-ffb239605aaa tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:13.663277 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-b89a9fcc-2d81-47fa-b773-ffb239605aaa tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 811 time: 0.1636984
May 27 09:38:13.668014 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e2fa916-28f9-419e-b31b-5997b84c9221 req-0f89b495-1b16-4016-9e85-374641496929 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:13.669546 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5e2fa916-28f9-419e-b31b-5997b84c9221 req-0f89b495-1b16-4016-9e85-374641496929 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=8969d19b-2ae2-4dd6-9861-e28e315bba3f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0820961
May 27 09:38:13.765097 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b59eb6a0-6963-498b-a2fe-deff931d7641 req-340b1de5-9fc0-4080-96e3-82c95678428c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 210 time: 0.0606563
May 27 09:38:13.772295 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ef297193-1e9f-474d-8b8c-82982028b457 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=b8df97a650014930beb6e52081be8e90 HTTP/1.1" status: 200  len: 380 time: 0.0921435
May 27 09:38:13.783394 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'port': {'device_id': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'admin_state_up': True, 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'security_groups': ['6de72829-ee9b-4468-8f5f-92fb65675d3b']}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:13.819202 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5e2fa916-28f9-419e-b31b-5997b84c9221 req-050b536f-2076-4920-9a6c-e99b77ae4e82 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1387422
May 27 09:38:13.924309 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:13.928294 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:port and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:38:13.931060 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for port was recalculated. Used quota:5. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:38:13.936956 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource port. Total usage: 5; quota limit: 500; headroom:495 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:13.946501 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Made reservation on behalf of b8df97a650014930beb6e52081be8e90 for: {'port': 1} {{(pid=91821) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}}
May 27 09:38:13.950196 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:13.957746 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-5e2fa916-28f9-419e-b31b-5997b84c9221 req-2b184b7d-e3d3-4577-9ad2-b6676ebea55f service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1317139
May 27 09:38:14.119916 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Allocated IP 172.20.0.10 (d58a455f-cc80-4aa7-a530-ce993d4da5e4/3187e919-f2c3-422d-8e9c-3d158ef72b40/348676ad-03f8-47de-9659-1a3ee03e948d) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:38:14.319872 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:14.338109 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Transition to ACTIVE for port object 348676ad-03f8-47de-9659-1a3ee03e948d will not be triggered until provisioned by entity DHCP. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:38:14.364307 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:14.370019 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8879a9c4-d6f2-4467-adc5-7c653095f03c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:14.441181 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Network d58a455f-cc80-4aa7-a530-ce993d4da5e4 is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:38:14.444153 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:38:14.448072 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:38:14.480011 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'Port': ['ID=348676ad-03f8-47de-9659-1a3ee03e948d,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:14.489022 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:14.571928 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:14.572570 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:14.606157 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-ff0d9857-ba1b-4f20-9c50-569460e6376f tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "POST /v2.0/ports HTTP/1.1" status: 201  len: 934 time: 0.8282087
May 27 09:38:14.618771 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f662f979-7055-4ce4-95bc-d1fa88f1c077 req-db6c65ac-20b0-47ca-9914-86aa2c6414a4 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:14.620301 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f662f979-7055-4ce4-95bc-d1fa88f1c077 req-db6c65ac-20b0-47ca-9914-86aa2c6414a4 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 944 time: 0.1378162
May 27 09:38:14.625727 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Request body: {'port': {'device_id': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77262'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:14.704913 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-1d185e6b-1c0c-416c-948c-c7422a1de190 None None] Provisioning for port 348676ad-03f8-47de-9659-1a3ee03e948d completed by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:38:14.709781 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-1d185e6b-1c0c-416c-948c-c7422a1de190 None None] Provisioning complete for port 348676ad-03f8-47de-9659-1a3ee03e948d triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:38:14.710241 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1d185e6b-1c0c-416c-948c-c7422a1de190 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:14.741954 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f662f979-7055-4ce4-95bc-d1fa88f1c077 req-068b4efa-3c2d-4cce-9cfa-eea478911d78 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0916586
May 27 09:38:14.766495 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-1d185e6b-1c0c-416c-948c-c7422a1de190 None None] Port 348676ad-03f8-47de-9659-1a3ee03e948d cannot update to ACTIVE because it is not bound. {{(pid=91822) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}}
May 27 09:38:14.771871 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:14.945622 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:15.195517 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16ba0d10-00a3-4340-953f-a2ed0900f851 req-034dc2f4-f4a9-4c1a-9e57-dff1f1ef90e4 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:15.196210 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-16ba0d10-00a3-4340-953f-a2ed0900f851 req-034dc2f4-f4a9-4c1a-9e57-dff1f1ef90e4 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Synchronizing usage tracker for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:38:15.229998 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-16ba0d10-00a3-4340-953f-a2ed0900f851 req-034dc2f4-f4a9-4c1a-9e57-dff1f1ef90e4 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Unset dirty status for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:38:15.231127 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-16ba0d10-00a3-4340-953f-a2ed0900f851 req-034dc2f4-f4a9-4c1a-9e57-dff1f1ef90e4 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 932 time: 0.3423316
May 27 09:38:15.335806 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 348676ad-03f8-47de-9659-1a3ee03e948d {{(pid=91821) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:38:15.342680 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-16ba0d10-00a3-4340-953f-a2ed0900f851 req-c91b716a-9cb7-400d-8d5f-bcbcebb2a7c6 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0998685
May 27 09:38:15.347241 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:15.362756 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.provisioning_blocks [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Transition to ACTIVE for port object 348676ad-03f8-47de-9659-1a3ee03e948d will not be triggered until provisioned by entity L2. {{(pid=91821) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}}
May 27 09:38:15.369908 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:15.374156 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-976bf889-7425-4dd9-9a14-a95707d9a167 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:15.500310 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Pushing event updated for resources: {'Port': ['ID=348676ad-03f8-47de-9659-1a3ee03e948d,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:15.526846 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:15.608613 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Attempting to bind port 348676ad-03f8-47de-9659-1a3ee03e948d on host hv-cinder-77262 for vnic_type normal with profile  {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}}
May 27 09:38:15.609008 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Attempting to bind port 348676ad-03f8-47de-9659-1a3ee03e948d by drivers openvswitch,hyperv on host hv-cinder-77262 at level 0 using segments [{'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}}
May 27 09:38:15.609346 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Attempting to bind port 348676ad-03f8-47de-9659-1a3ee03e948d on network d58a455f-cc80-4aa7-a530-ce993d4da5e4 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:38:15.614013 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Port 348676ad-03f8-47de-9659-1a3ee03e948d on network d58a455f-cc80-4aa7-a530-ce993d4da5e4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77262 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}}
May 27 09:38:15.614343 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Attempting to bind port 348676ad-03f8-47de-9659-1a3ee03e948d on network d58a455f-cc80-4aa7-a530-ce993d4da5e4 {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}}
May 27 09:38:15.619480 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Checking agent: {'id': 'ad14ce73-63e3-40a1-ab3f-b55bdb08b481', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77262', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'started_at': datetime.datetime(2021, 5, 27, 9, 25, 26), 'heartbeat_timestamp': datetime.datetime(2021, 5, 27, 9, 37, 56), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}}
May 27 09:38:15.619823 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Checking segment: {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91821) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}}
May 27 09:38:15.620211 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Bound using segment: {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'} {{(pid=91821) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}}
May 27 09:38:15.620680 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.managers [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Bound port: 348676ad-03f8-47de-9659-1a3ee03e948d, host: hv-cinder-77262, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c16c67eb-22c2-4695-a761-73d0611cf64a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 393, 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4'}}] {{(pid=91821) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}}
May 27 09:38:15.621001 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:15.720354 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] For port 348676ad-03f8-47de-9659-1a3ee03e948d, host hv-cinder-77262, cleared binding levels {{(pid=91821) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}}
May 27 09:38:15.723562 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] For port 348676ad-03f8-47de-9659-1a3ee03e948d, host hv-cinder-77262, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=348676ad-03f8-47de-9659-1a3ee03e948d,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91821) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}}
May 27 09:38:15.728349 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:15.733869 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e6bbb7a4-5ff7-4f03-92ce-c90137c922ba tempest-VolumesNegativeTest-849110095 tempest-VolumesNegativeTest-849110095-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:15.793769 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:15.794391 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:15.796642 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] 10.222.0.11 "PUT /v2.0/ports/348676ad-03f8-47de-9659-1a3ee03e948d HTTP/1.1" status: 200  len: 1094 time: 1.1752238
May 27 09:38:15.797255 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'tag': '348676ad-03f8-47de-9659-1a3ee03e948d'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:38:15.824903 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Pushing event updated for resources: {'Port': ['ID=348676ad-03f8-47de-9659-1a3ee03e948d,revision_number=3']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:15.828430 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:15.942814 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'tag': '348676ad-03f8-47de-9659-1a3ee03e948d', 'status': 'completed', 'code': 200}
May 27 09:38:16.029554 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188e3ced-3acb-4c40-a39e-cb9c6b751929 req-86b94c9c-e435-4aa9-9fdb-83deb610c946 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:16.031163 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-188e3ced-3acb-4c40-a39e-cb9c6b751929 req-86b94c9c-e435-4aa9-9fdb-83deb610c946 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 944 time: 0.1389399
May 27 09:38:16.033130 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-e3d661d8-3fb2-4e37-aa93-fdb56b2e8dbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:16.034439 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-e3d661d8-3fb2-4e37-aa93-fdb56b2e8dbe service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 1097 time: 0.1903510
May 27 09:38:16.117838 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-abca0c48-24f7-40d6-a1c6-f84da96b44b3 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=348676ad-03f8-47de-9659-1a3ee03e948d HTTP/1.1" status: 200  len: 217 time: 0.0654833
May 27 09:38:16.181730 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-188e3ced-3acb-4c40-a39e-cb9c6b751929 req-b401e475-9913-42b9-8a0c-fce0b56c47b6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.1448643
May 27 09:38:16.198480 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-895a8755-a5f7-446c-972d-1aa0110db757 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:16.199907 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-895a8755-a5f7-446c-972d-1aa0110db757 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0732265
May 27 09:38:16.276403 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-7089a3fb-052b-42af-afdd-a73dd4959748 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:16.277769 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-7089a3fb-052b-42af-afdd-a73dd4959748 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0713089
May 27 09:38:16.379246 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device d9fbaf8a-ddda-4038-b9c9-3c246b80818a details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:38:16.414327 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-9feda532-d035-45bb-b360-422904439d73 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1292400
May 27 09:38:16.520840 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port d9fbaf8a-ddda-4038-b9c9-3c246b80818a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:38:16.533798 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'port_id': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'mac_address': 'fa:16:3e:e2:9f:92', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 398, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:38:16.588283 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:16.606729 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d9fbaf8a-ddda-4038-b9c9-3c246b80818a {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:38:16.609332 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d140ff91-cd13-4bb4-ad92-31c8b178f48b req-5b9b9274-5d93-43f2-a6a5-351a28179f51 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1890275
May 27 09:38:16.621400 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64fdcf60-f5ab-4714-8a11-46c687b5fc86 req-771309ef-f902-4c3e-80a0-a8b837162766 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:16.623254 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-64fdcf60-f5ab-4714-8a11-46c687b5fc86 req-771309ef-f902-4c3e-80a0-a8b837162766 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 944 time: 0.1317828
May 27 09:38:16.627656 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port d9fbaf8a-ddda-4038-b9c9-3c246b80818a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:38:16.632047 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:16.633873 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:16.705678 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:16.708782 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:16.714903 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-64fdcf60-f5ab-4714-8a11-46c687b5fc86 req-605c324f-eac2-45d3-9ca0-cbdf2fa3a2ef tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0827613
May 27 09:38:16.742052 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cc1e84-d27e-426c-91e3-2b74e679d7e8 req-424051dc-14ad-4e02-8876-eabf7d9346ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:16.743542 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-99cc1e84-d27e-426c-91e3-2b74e679d7e8 req-424051dc-14ad-4e02-8876-eabf7d9346ba service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 1097 time: 0.0825205
May 27 09:38:16.871780 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['d9fbaf8a-ddda-4038-b9c9-3c246b80818a'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:38:16.874323 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cc1e84-d27e-426c-91e3-2b74e679d7e8 req-b2a8b174-7797-4eb7-9e4f-c87b4a7e6080 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:16.875839 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-99cc1e84-d27e-426c-91e3-2b74e679d7e8 req-b2a8b174-7797-4eb7-9e4f-c87b4a7e6080 service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.1258123
May 27 09:38:17.049157 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-99cc1e84-d27e-426c-91e3-2b74e679d7e8 req-ce98c574-5ca1-4b20-a5fa-4215c0eec2ed service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=348676ad-03f8-47de-9659-1a3ee03e948d HTTP/1.1" status: 200  len: 217 time: 0.1659772
May 27 09:38:17.114393 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cc1e84-d27e-426c-91e3-2b74e679d7e8 req-c2fa6f36-192e-4db8-8b0f-757da5491db5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:17.115915 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-99cc1e84-d27e-426c-91e3-2b74e679d7e8 req-c2fa6f36-192e-4db8-8b0f-757da5491db5 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0573030
May 27 09:38:17.196167 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99cc1e84-d27e-426c-91e3-2b74e679d7e8 req-15c6ae4b-5b10-4430-a477-7ce4ad611ac4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:17.197606 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-99cc1e84-d27e-426c-91e3-2b74e679d7e8 req-15c6ae4b-5b10-4430-a477-7ce4ad611ac4 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0727222
May 27 09:38:17.385093 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-99cc1e84-d27e-426c-91e3-2b74e679d7e8 req-ce3c3533-43c5-4e55-967a-810375946e1d service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1779540
May 27 09:38:17.430689 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4716b1a-6848-474e-95e8-20ab331ab83a req-02cea228-ddaa-4501-8bc7-d6e4a6deb56e tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:17.432168 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a4716b1a-6848-474e-95e8-20ab331ab83a req-02cea228-ddaa-4501-8bc7-d6e4a6deb56e tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 945 time: 0.1415861
May 27 09:38:17.548393 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a4716b1a-6848-474e-95e8-20ab331ab83a req-ef0de2ba-937c-4edf-8f38-1b67d63d483a tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0740881
May 27 09:38:17.567350 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-99cc1e84-d27e-426c-91e3-2b74e679d7e8 req-c588dabb-cfa7-498d-9efd-e7267b108786 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1751192
May 27 09:38:17.896586 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f55eb2a-82d8-407e-87ac-3ccd824071c0 req-8eabb153-5b0c-4fcb-a545-310c9fb5fbc9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:17.898007 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3f55eb2a-82d8-407e-87ac-3ccd824071c0 req-8eabb153-5b0c-4fcb-a545-310c9fb5fbc9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 944 time: 0.0798943
May 27 09:38:17.942556 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3f55eb2a-82d8-407e-87ac-3ccd824071c0 req-cb9ad62d-1776-4e4f-a71c-ab6a14b3e8e4 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0389228
May 27 09:38:18.395913 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device d9fbaf8a-ddda-4038-b9c9-3c246b80818a up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:38:18.462422 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port d9fbaf8a-ddda-4038-b9c9-3c246b80818a completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:38:18.467540 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port d9fbaf8a-ddda-4038-b9c9-3c246b80818a triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:38:18.468091 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:18.586133 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:18.614163 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:38:18.624939 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port d9fbaf8a-ddda-4038-b9c9-3c246b80818a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:38:18.629574 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:18.631058 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-91f53f04-080e-4935-b372-154faf69846a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:18.703811 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:18.707069 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:18.719272 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'code': 200}
May 27 09:38:18.751065 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7005a6-081a-402e-8a8c-fe2a7be1399f req-93392673-87f3-4a75-97db-9424aa71d029 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:18.752563 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1b7005a6-081a-402e-8a8c-fe2a7be1399f req-93392673-87f3-4a75-97db-9424aa71d029 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 946 time: 0.0985057
May 27 09:38:18.800399 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1b7005a6-081a-402e-8a8c-fe2a7be1399f req-137f6b8a-2397-4a9f-b970-90fb59d10439 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0413768
May 27 09:38:18.944307 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1082979-c50a-4ee5-ab98-0013c6f0b81f req-a8e410e1-131d-4e30-8c81-b1c61a055ea4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:18.945744 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f1082979-c50a-4ee5-ab98-0013c6f0b81f req-a8e410e1-131d-4e30-8c81-b1c61a055ea4 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 1099 time: 0.0695381
May 27 09:38:18.988930 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f1082979-c50a-4ee5-ab98-0013c6f0b81f req-36eb180f-59db-41e5-9c5b-b85f5c318b37 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0361855
May 27 09:38:19.139716 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94af7a4d-4e4f-4d3e-8e6b-3cf625a3aff2 req-c79d6b94-ef29-469d-9ba5-e751c2e115e3 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:19.141162 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-94af7a4d-4e4f-4d3e-8e6b-3cf625a3aff2 req-c79d6b94-ef29-469d-9ba5-e751c2e115e3 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 944 time: 0.0857697
May 27 09:38:19.187896 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-94af7a4d-4e4f-4d3e-8e6b-3cf625a3aff2 req-e82c627b-1e62-4125-9b98-ebf973b0f352 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0412040
May 27 09:38:19.984739 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4070a96f-c16c-4223-90a5-53f7788e0596 req-13b284ad-2142-4dda-92bd-38ee3824623a tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:19.986122 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4070a96f-c16c-4223-90a5-53f7788e0596 req-13b284ad-2142-4dda-92bd-38ee3824623a tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 946 time: 0.0794301
May 27 09:38:20.034047 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4070a96f-c16c-4223-90a5-53f7788e0596 req-2b824f43-e34e-42f4-a82c-0f4498093942 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0422885
May 27 09:38:20.214820 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-faa224b7-090f-4c00-a68a-8d9e0502d21b req-3788b0a4-de15-4bed-84ff-277235f2a794 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:20.216336 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-faa224b7-090f-4c00-a68a-8d9e0502d21b req-3788b0a4-de15-4bed-84ff-277235f2a794 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 946 time: 0.0797741
May 27 09:38:20.262201 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-faa224b7-090f-4c00-a68a-8d9e0502d21b req-8878a77b-a7e3-4c73-b90a-7d296a30dfed tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0392284
May 27 09:38:20.376991 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc69b4ab-d64d-4e2f-ab71-74943d2bdfb4 req-64adf1d1-8053-4303-914e-778bd983890c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:20.378491 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cc69b4ab-d64d-4e2f-ab71-74943d2bdfb4 req-64adf1d1-8053-4303-914e-778bd983890c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 944 time: 0.0865149
May 27 09:38:20.424966 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cc69b4ab-d64d-4e2f-ab71-74943d2bdfb4 req-3cc31cd3-661e-4c41-acea-39d4bed9120c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0404327
May 27 09:38:20.655817 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033c4b47-7fbf-4a34-ba97-d9589fc12840 req-0b97cfcc-99be-41fb-8963-63b7fd73eada tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:20.657285 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-033c4b47-7fbf-4a34-ba97-d9589fc12840 req-0b97cfcc-99be-41fb-8963-63b7fd73eada tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 946 time: 0.0823734
May 27 09:38:20.702242 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-033c4b47-7fbf-4a34-ba97-d9589fc12840 req-45027961-db6c-49e3-8ffb-446ea6ef8114 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0387349
May 27 09:38:21.626640 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bcfeaf1-b24c-4bcd-849d-143f2bade368 req-c1a23258-6c37-46cb-81d0-e8c77ef89cfa tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:21.628136 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4bcfeaf1-b24c-4bcd-849d-143f2bade368 req-c1a23258-6c37-46cb-81d0-e8c77ef89cfa tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 944 time: 0.0865812
May 27 09:38:21.671974 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4bcfeaf1-b24c-4bcd-849d-143f2bade368 req-e73aa47b-cdc9-49a0-973b-d4a15b1540a8 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0381961
May 27 09:38:22.866649 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40784196-0de8-4ca0-a68e-986f2663b3cb req-1210b77e-8d96-49df-9cb8-81314375a80a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:22.868204 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40784196-0de8-4ca0-a68e-986f2663b3cb req-1210b77e-8d96-49df-9cb8-81314375a80a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 944 time: 0.0858052
May 27 09:38:22.920660 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-40784196-0de8-4ca0-a68e-986f2663b3cb req-c01d5967-cc42-4030-afb7-6cff94b0bece tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0435069
May 27 09:38:24.113659 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cd3f540-29a1-481b-ae26-b5f89b14578e req-57b82d0d-975d-44b6-8d20-49dc692ee856 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:24.115117 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1cd3f540-29a1-481b-ae26-b5f89b14578e req-57b82d0d-975d-44b6-8d20-49dc692ee856 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 944 time: 0.0815279
May 27 09:38:24.161476 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1cd3f540-29a1-481b-ae26-b5f89b14578e req-a2bf8206-2b47-4743-85ff-ec1c007bb29a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0405624
May 27 09:38:24.414731 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 348676ad-03f8-47de-9659-1a3ee03e948d details requested by agent hyperv_hv-cinder-77262 with host hv-cinder-77262 {{(pid=91822) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}}
May 27 09:38:24.546870 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 348676ad-03f8-47de-9659-1a3ee03e948d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=348676ad-03f8-47de-9659-1a3ee03e948d,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:38:24.559464 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Returning: {'device': '348676ad-03f8-47de-9659-1a3ee03e948d', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'port_id': '348676ad-03f8-47de-9659-1a3ee03e948d', 'mac_address': 'fa:16:3e:30:89:09', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 393, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91822) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}}
May 27 09:38:24.613405 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:24.630318 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 348676ad-03f8-47de-9659-1a3ee03e948d {{(pid=91822) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}}
May 27 09:38:24.645304 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 348676ad-03f8-47de-9659-1a3ee03e948d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=348676ad-03f8-47de-9659-1a3ee03e948d,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:38:24.649133 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:24.650801 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:24.717987 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=348676ad-03f8-47de-9659-1a3ee03e948d,revision_number=4']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:24.721011 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:24.868318 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['348676ad-03f8-47de-9659-1a3ee03e948d'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:38:25.346768 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fed5b141-b9ad-4387-a0b2-c1abda378c5b req-de2e0884-8db2-4a62-ae0b-b0139454907c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:25.348418 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fed5b141-b9ad-4387-a0b2-c1abda378c5b req-de2e0884-8db2-4a62-ae0b-b0139454907c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 945 time: 0.0833890
May 27 09:38:25.486724 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fed5b141-b9ad-4387-a0b2-c1abda378c5b req-26c69217-e757-477d-9ceb-e6c70ca10913 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1326632
May 27 09:38:26.427272 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 348676ad-03f8-47de-9659-1a3ee03e948d up at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}}
May 27 09:38:26.498048 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:26.507182 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning for port 348676ad-03f8-47de-9659-1a3ee03e948d completed by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}}
May 27 09:38:26.511767 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Provisioning complete for port 348676ad-03f8-47de-9659-1a3ee03e948d triggered by entity L2. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:38:26.512158 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:26.632455 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:26.658912 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '348676ad-03f8-47de-9659-1a3ee03e948d'}] {{(pid=91822) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:38:26.669280 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c3741f-1ea4-488a-8d26-d2eb05835ec1 req-c48e2520-78a9-4340-baae-fadeb53dcd14 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:26.671359 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-86c3741f-1ea4-488a-8d26-d2eb05835ec1 req-c48e2520-78a9-4340-baae-fadeb53dcd14 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 945 time: 0.0805695
May 27 09:38:26.677252 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] For port 348676ad-03f8-47de-9659-1a3ee03e948d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=348676ad-03f8-47de-9659-1a3ee03e948d,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:38:26.684671 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686'] for port, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:26.687793 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:26.718890 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-86c3741f-1ea4-488a-8d26-d2eb05835ec1 req-f75bd825-85d7-46f5-b5b7-3206ee89b0df tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0402229
May 27 09:38:26.720522 dv-cinder-772623-6-iscsi neutron-server[91822]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '348676ad-03f8-47de-9659-1a3ee03e948d', 'code': 200}
May 27 09:38:26.759987 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Pushing event updated for resources: {'Port': ['ID=348676ad-03f8-47de-9659-1a3ee03e948d,revision_number=5']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:26.762911 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:26.989623 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30194d98-c8c1-4388-9c86-946f1e3291f1 req-43e15db4-eb73-417d-aceb-45aeaae51fb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:26.991097 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-30194d98-c8c1-4388-9c86-946f1e3291f1 req-43e15db4-eb73-417d-aceb-45aeaae51fb2 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 1099 time: 0.0727835
May 27 09:38:27.030992 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-30194d98-c8c1-4388-9c86-946f1e3291f1 req-dbf44295-a754-4509-8584-c6ed69e2a0b6 service neutron] 10.222.0.11 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0336673
May 27 09:38:27.924155 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8ee899-0bc1-4cb0-b9e9-831680893544 req-0c53aca1-603b-4a1b-9d27-d962c6a8ea84 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:27.925579 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dc8ee899-0bc1-4cb0-b9e9-831680893544 req-0c53aca1-603b-4a1b-9d27-d962c6a8ea84 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 946 time: 0.0877569
May 27 09:38:27.979543 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dc8ee899-0bc1-4cb0-b9e9-831680893544 req-5e4cb584-03bc-4ca8-9216-2f8a6fe1df75 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0451553
May 27 09:38:29.166105 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01791d26-dea1-45bc-99a3-8e307815608a req-934879f6-4b07-4de1-901e-38bf513878b9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:29.167606 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-01791d26-dea1-45bc-99a3-8e307815608a req-934879f6-4b07-4de1-901e-38bf513878b9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 946 time: 0.0843108
May 27 09:38:29.216163 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-01791d26-dea1-45bc-99a3-8e307815608a req-62cba5a1-d367-4998-b731-8d93b5446ca5 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0418549
May 27 09:38:29.412222 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6820283-c529-43b9-a276-d4820331ed2d req-ec21fe70-7da1-45c4-aa12-6778d004255c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:29.413716 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d6820283-c529-43b9-a276-d4820331ed2d req-ec21fe70-7da1-45c4-aa12-6778d004255c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 946 time: 0.0848734
May 27 09:38:29.459021 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d6820283-c529-43b9-a276-d4820331ed2d req-a9ea23d0-2381-4b7a-8728-bce92cd60240 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0396414
May 27 09:38:29.483262 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58334) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:38:29.571272 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50262911-f613-4e53-a7dc-e619e17c6b01 tempest-TestVolumeBootPattern-1068691054 tempest-TestVolumeBootPattern-1068691054-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:29.575158 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-50262911-f613-4e53-a7dc-e619e17c6b01 tempest-TestVolumeBootPattern-1068691054 tempest-TestVolumeBootPattern-1068691054-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 1094 time: 0.0889759
May 27 09:38:29.576064 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58340) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:38:29.582061 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Request body: {'floatingip': {'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'port_id': '348676ad-03f8-47de-9659-1a3ee03e948d', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address': '172.20.0.10'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:29.588084 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:29.591966 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Usage tracker for resource:floatingip and tenant:b8df97a650014930beb6e52081be8e90 is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:38:29.595124 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:38:29.601079 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:29.612481 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:29.749458 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:29.938363 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_common [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Allocated IP 172.27.1.204 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/de6a1dbd-4d37-4be9-b68e-dc2cb6c726e1) {{(pid=91821) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:38:30.040800 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85b6cc21-3781-4b58-bceb-dec49619fc94 req-d58e219c-2e35-44af-96b4-fb5530925d99 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:30.042287 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85b6cc21-3781-4b58-bceb-dec49619fc94 req-d58e219c-2e35-44af-96b4-fb5530925d99 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 946 time: 0.1845403
May 27 09:38:30.128206 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-85b6cc21-3781-4b58-bceb-dec49619fc94 req-1cefb649-922c-4fa8-ad22-02200e17152c tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0789132
May 27 09:38:30.132744 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for port, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:30.153759 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58348) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:38:30.163896 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:30.167706 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-82e1faf3-5687-4f83-8b6f-ccd393412221 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:30.234952 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91821) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:38:30.238993 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.base_scheduler [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Resources bound (agent type, host, resource id):  {{(pid=91821) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:38:30.241612 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Received port after_create {{(pid=91821) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:38:30.271280 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0180bccc-01e1-48e7-9b57-2346dae49f54 tempest-TestMinimumBasicScenario-482108928 tempest-TestMinimumBasicScenario-482108928-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:30.272013 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-0180bccc-01e1-48e7-9b57-2346dae49f54 tempest-TestMinimumBasicScenario-482108928 tempest-TestMinimumBasicScenario-482108928-project-admin] Synchronizing usage tracker for tenant:9b65b8fc5dc14dcc9f87da1d8841c39c on resource:port {{(pid=91820) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:38:30.274734 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'Port': ['ID=de6a1dbd-4d37-4be9-b68e-dc2cb6c726e1,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:30.277684 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.110s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:30.289154 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-0180bccc-01e1-48e7-9b57-2346dae49f54 tempest-TestMinimumBasicScenario-482108928 tempest-TestMinimumBasicScenario-482108928-project-admin] Unset dirty status for tenant:9b65b8fc5dc14dcc9f87da1d8841c39c on resource:port {{(pid=91820) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:38:30.290312 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-0180bccc-01e1-48e7-9b57-2346dae49f54 tempest-TestMinimumBasicScenario-482108928 tempest-TestMinimumBasicScenario-482108928-project-admin] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 1094 time: 0.1349742
May 27 09:38:30.293378 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58354) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:38:30.300070 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Request body: {'floatingip': {'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'port_id': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'fixed_ip_address': '172.20.0.11'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:30.306298 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:30.310705 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Usage tracker for resource:floatingip and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:38:30.313834 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:38:30.319700 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:30.330526 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for floatingip, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:30.469460 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:30.638048 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_common [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Allocated IP 172.27.1.251 (8ebf3ddf-9506-4320-bd22-b3ade14a6cae/4506464c-a125-4c0f-8a03-19e4816fe82e/c7a70175-2d7b-4d8f-9169-4306c5f6843c) {{(pid=91820) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}}
May 27 09:38:30.683964 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:30.869043 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:30.914197 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for port, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:30.944165 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8739971057107', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:30.948712 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:31.013260 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Network 8ebf3ddf-9506-4320-bd22-b3ade14a6cae is already hosted by enough agents. {{(pid=91820) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}}
May 27 09:38:31.016249 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.base_scheduler [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources bound (agent type, host, resource id):  {{(pid=91820) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}}
May 27 09:38:31.020023 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Received port after_create {{(pid=91820) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}}
May 27 09:38:31.055266 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'Port': ['ID=c7a70175-2d7b-4d8f-9169-4306c5f6843c,revision_number=1']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:31.071687 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.072080 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.072505 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.072859 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.073238 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.073608 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.073981 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.074350 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.074718 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.075083 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.075475 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.075843 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:31.081249 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:31.085499 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:31.090160 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:31.094873 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-18c57b57-2dfb-44ac-9677-d8762a9da5ee service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:31.200009 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event updated for resources: {'Port': ['ID=de6a1dbd-4d37-4be9-b68e-dc2cb6c726e1,revision_number=2']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:31.204223 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.109s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:31.216541 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:31.408218 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.l3_db [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Floating IP f2738fd6-55cf-4816-bd37-b20d5a49d7c7 associated. External IP: 172.27.1.204, port: 348676ad-03f8-47de-9659-1a3ee03e948d.
May 27 09:38:31.466703 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:31.543527 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:31.756945 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for port, precommit_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:31.762620 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2421863'] for port, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:31.768753 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6a1cb6c5-f065-4c03-8133-2faacff9b6e4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:31.848327 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:38:31.877456 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'Port': ['ID=c7a70175-2d7b-4d8f-9169-4306c5f6843c,revision_number=2']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:31.881655 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:31.889776 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-3811307'] for floatingip, after_update {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:31.955746 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-652d24df-b3c9-4efd-85c4-32b6c85f1f20 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.1717453
May 27 09:38:32.065140 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.l3_db [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Floating IP a2d30df4-18ac-400f-965b-cee83a5de7bd associated. External IP: 172.27.1.251, port: d9fbaf8a-ddda-4038-b9c9-3c246b80818a.
May 27 09:38:32.100169 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:38:32.110420 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcc711db-6fdd-4914-9d6d-a81f795224fc None None] Sync routers for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:38:32.120507 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcc711db-6fdd-4914-9d6d-a81f795224fc None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:38:32.121709 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-dcc711db-6fdd-4914-9d6d-a81f795224fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec76a4c0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:38:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:38:32.134967 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-ea6512b9-ddd6-4b80-b7e2-02b1104a7a21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:32.136753 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-ea6512b9-ddd6-4b80-b7e2-02b1104a7a21 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 1099 time: 0.1090624
May 27 09:38:32.137496 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:32.324222 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-dcc711db-6fdd-4914-9d6d-a81f795224fc None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:38:32.399405 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.8182752
May 27 09:38:32.399405 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'tag': '348676ad-03f8-47de-9659-1a3ee03e948d'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:38:32.453416 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-0c7674a8-a8be-4157-ba3c-ddc4f9646e07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:32.454967 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-0c7674a8-a8be-4157-ba3c-ddc4f9646e07 service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.2915215
May 27 09:38:32.456672 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'tag': '348676ad-03f8-47de-9659-1a3ee03e948d', 'status': 'completed', 'code': 200}
May 27 09:38:32.578448 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-1077d345-0c4f-42aa-89ea-6815378784a2 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845 HTTP/1.1" status: 200  len: 1001 time: 0.1090972
May 27 09:38:32.640729 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:38:32.651605 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-e208f1f4-d6df-4f0c-ac7d-e8e7f6fe7034 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:32.653077 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-e208f1f4-d6df-4f0c-ac7d-e8e7f6fe7034 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0668304
May 27 09:38:32.714496 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b5e0f39-a063-4172-b03e-e218817bd84d req-f05641c7-8241-416f-9765-e5856e14da65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:32.716176 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8b5e0f39-a063-4172-b03e-e218817bd84d req-f05641c7-8241-416f-9765-e5856e14da65 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 1099 time: 0.1806920
May 27 09:38:32.733909 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-6c66fc1f-dd99-4e66-8f3b-44a6631575ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:32.735576 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-6c66fc1f-dd99-4e66-8f3b-44a6631575ff service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0740092
May 27 09:38:32.743597 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-dcc711db-6fdd-4914-9d6d-a81f795224fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec76a4c0>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '7d9344fd-2118-4536-92dd-e198af5c71ff', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.30', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:d1:91:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:36:31Z', 'updated_at': '2021-05-27T09:36:34Z', 'revision_number': 1, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}, {'id': 'f2738fd6-55cf-4816-bd37-b20d5a49d7c7', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.204', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '348676ad-03f8-47de-9659-1a3ee03e948d', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:30:89:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:38:30Z', 'updated_at': '2021-05-27T09:38:30Z', 'revision_number': 0, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:38:32.748398 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcc711db-6fdd-4914-9d6d-a81f795224fc None None] Checking router: 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:38:32.757271 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dcc711db-6fdd-4914-9d6d-a81f795224fc None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:38:32.758132 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-dcc711db-6fdd-4914-9d6d-a81f795224fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec76a4c0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:38:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:38:32.870448 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-396a46b3-13c1-4150-b32c-572c2e4402cc service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1270714
May 27 09:38:32.942485 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-dcc711db-6fdd-4914-9d6d-a81f795224fc None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:38:32.958403 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:38:32.969481 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a155b20-e8c7-4309-ac76-7f60015b94e5 None None] Sync routers for ids ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:38:32.980406 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a155b20-e8c7-4309-ac76-7f60015b94e5 None None] Routers {'15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:38:32.981379 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-0a155b20-e8c7-4309-ac76-7f60015b94e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecf35760>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:38:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:38:32.986179 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b5e0f39-a063-4172-b03e-e218817bd84d req-f1853518-3445-4d67-b867-afdd2b0c8783 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:32.987844 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8b5e0f39-a063-4172-b03e-e218817bd84d req-f1853518-3445-4d67-b867-afdd2b0c8783 service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.2616012
May 27 09:38:32.990121 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:33.023041 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-46d69105-fc3b-4fff-ae5b-03e19a0742bf req-4d5ccadf-129b-432a-966f-564517d6895f service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1433315
May 27 09:38:33.106339 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "POST /v2.0/floatingips HTTP/1.1" status: 201  len: 997 time: 2.8112209
May 27 09:38:33.110039 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58362) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:38:33.117595 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1455814819', 'description': 'tempest-secgroup-smoke-1455814819 description', 'project_id': '892895f1788940b1bc09406239590e3f'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:33.121578 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:33.131796 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:33.140349 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:38:33.144374 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:33.166719 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:33.170875 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Usage tracker for resource:security_group_rule and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:38:33.174017 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:38:33.180036 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:33.187470 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8b5e0f39-a063-4172-b03e-e218817bd84d req-44f698f6-9afb-4c46-999f-318ce7ec934e service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=348676ad-03f8-47de-9659-1a3ee03e948d HTTP/1.1" status: 200  len: 1000 time: 0.1592300
May 27 09:38:33.193495 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-0a155b20-e8c7-4309-ac76-7f60015b94e5 None None] Set router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:38:33.235996 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'status': 'completed', 'code': 200}
May 27 09:38:33.262723 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b5e0f39-a063-4172-b03e-e218817bd84d req-d76a6dd0-8590-4fb3-905b-01b39e0a9c33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:33.264289 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8b5e0f39-a063-4172-b03e-e218817bd84d req-d76a6dd0-8590-4fb3-905b-01b39e0a9c33 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0698609
May 27 09:38:33.277830 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:33.324984 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:33.335854 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-4777a5e4-3c66-45ec-808f-14a0d9d93fc9 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:33.355307 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-dcc711db-6fdd-4914-9d6d-a81f795224fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec76a4c0>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '7d9344fd-2118-4536-92dd-e198af5c71ff', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.30', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:d1:91:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:36:31Z', 'updated_at': '2021-05-27T09:36:34Z', 'revision_number': 1, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}, {'id': 'f2738fd6-55cf-4816-bd37-b20d5a49d7c7', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.204', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '348676ad-03f8-47de-9659-1a3ee03e948d', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:30:89:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:38:30Z', 'updated_at': '2021-05-27T09:38:30Z', 'revision_number': 0, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:38:33.361341 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dcc711db-6fdd-4914-9d6d-a81f795224fc None None] The sync data for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi is: [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '7d9344fd-2118-4536-92dd-e198af5c71ff', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.30', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:d1:91:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:36:31Z', 'updated_at': '2021-05-27T09:36:34Z', 'revision_number': 1, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}, {'id': 'f2738fd6-55cf-4816-bd37-b20d5a49d7c7', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.204', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '348676ad-03f8-47de-9659-1a3ee03e948d', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 677, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:30:89:09', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:38:30Z', 'updated_at': '2021-05-27T09:38:30Z', 'revision_number': 0, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:38:33.370009 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b5e0f39-a063-4172-b03e-e218817bd84d req-7a21d60a-d65b-47e3-aba7-be62b07ce4d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91820) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:33.372520 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8b5e0f39-a063-4172-b03e-e218817bd84d req-7a21d60a-d65b-47e3-aba7-be62b07ce4d1 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0997078
May 27 09:38:33.418531 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c16ad23f-ff81-4150-9e90-da0adc4ab56a,revision_number=1']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:33.425830 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:33.428064 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:33.429283 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-d13ede4d-d3b5-4e9a-9d46-e139cc050eba tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "POST /v2.0/security-groups HTTP/1.1" status: 201  len: 1794 time: 0.3182106
May 27 09:38:33.432339 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58368) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:38:33.440536 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Request body: {'security_group_rule': {'security_group_id': 'c16ad23f-ff81-4150-9e90-da0adc4ab56a', 'project_id': '892895f1788940b1bc09406239590e3f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:33.448964 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:33.455025 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Usage tracker for resource:security_group_rule and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:38:33.458909 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:38:33.464603 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9cdc461-6df3-4757-a177-47108aacd997 req-1a801b63-b65b-4488-9f58-dd2ba838d628 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:33.466072 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a9cdc461-6df3-4757-a177-47108aacd997 req-1a801b63-b65b-4488-9f58-dd2ba838d628 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=892895f1788940b1bc09406239590e3f&device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 1099 time: 0.1830847
May 27 09:38:33.470356 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:33.534106 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8b5e0f39-a063-4172-b03e-e218817bd84d req-526a6c1a-2e9a-495d-9755-8e2586f52e03 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1541491
May 27 09:38:33.562455 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:33.610575 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-0a155b20-e8c7-4309-ac76-7f60015b94e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecf35760>, [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 4, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': 'a2d30df4-18ac-400f-965b-cee83a5de7bd', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'floating_ip_address': '172.27.1.251', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'port_id': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 678, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'mac_address': 'fa:16:3e:e2:9f:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:38:31Z', 'updated_at': '2021-05-27T09:38:31Z', 'revision_number': 0, 'project_id': '892895f1788940b1bc09406239590e3f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c7ac200f-e253-44d5-8112-cc54a37d8ba6', 'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'mac_address': 'fa:16:3e:21:ef:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:39Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 5, 'project_id': '892895f1788940b1bc09406239590e3f', 'subnets': [{'id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:38:33.614702 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a155b20-e8c7-4309-ac76-7f60015b94e5 None None] Checking router: 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:38:33.623910 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0a155b20-e8c7-4309-ac76-7f60015b94e5 None None] Routers {'15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:38:33.624441 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-0a155b20-e8c7-4309-ac76-7f60015b94e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecf35760>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:38:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:38:33.678385 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9cdc461-6df3-4757-a177-47108aacd997 req-9fef07d5-1b39-4f65-859f-177afc939422 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:33.679884 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a9cdc461-6df3-4757-a177-47108aacd997 req-9fef07d5-1b39-4f65-859f-177afc939422 service neutron] 10.222.0.11 "GET /v2.0/networks?id=8969d19b-2ae2-4dd6-9861-e28e315bba3f HTTP/1.1" status: 200  len: 915 time: 0.2058644
May 27 09:38:33.681626 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6af6bc1a-1b10-4c57-9657-449fa3657296 None None] New status for floating IP f2738fd6-55cf-4816-bd37-b20d5a49d7c7: ACTIVE {{(pid=91822) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:38:33.707579 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [req-8b5e0f39-a063-4172-b03e-e218817bd84d req-de592429-d054-4fe9-bcea-358455b2d800 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1658106
May 27 09:38:33.753389 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:33.768720 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:33.781794 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-be253932-209a-4815-8e62-ffdcba25eb65 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:33.807160 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-0a155b20-e8c7-4309-ac76-7f60015b94e5 None None] Set router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:38:33.817152 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=58bf903f-661d-47d8-8c2a-8737fc81ddb6,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:33.821947 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:33.823968 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a9cdc461-6df3-4757-a177-47108aacd997 req-7c3a4e99-a99f-4203-90c9-77bd90791236 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 200  len: 1000 time: 0.1355276
May 27 09:38:33.825553 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:33.830516 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 764 time: 0.3939564
May 27 09:38:33.830725 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58372) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:38:33.835891 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Request body: {'security_group_rule': {'security_group_id': 'c16ad23f-ff81-4150-9e90-da0adc4ab56a', 'project_id': '892895f1788940b1bc09406239590e3f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:33.879907 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:33.893634 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Usage tracker for resource:security_group_rule and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:38:33.898044 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:38:33.906846 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:33.920814 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9cdc461-6df3-4757-a177-47108aacd997 req-a0a74d77-ab76-414e-a2c4-0f7c38e3ef52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:33.922303 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a9cdc461-6df3-4757-a177-47108aacd997 req-a0a74d77-ab76-414e-a2c4-0f7c38e3ef52 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c1677eac-45e9-4a22-9a63-044a5ded43ac HTTP/1.1" status: 200  len: 853 time: 0.0817881
May 27 09:38:33.930202 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.044542 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.051358 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9cdc461-6df3-4757-a177-47108aacd997 req-6352ae6a-ebfc-4727-a6b9-281bcf8b32bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:34.052889 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a9cdc461-6df3-4757-a177-47108aacd997 req-6352ae6a-ebfc-4727-a6b9-281bcf8b32bb service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=8969d19b-2ae2-4dd6-9861-e28e315bba3f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1236567
May 27 09:38:34.054061 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.056122 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-42aed945-6733-4dab-8bfb-6e7bae01c03d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:34.112563 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bb3a1f1a-f896-4880-84c4-fc0dfb089f9f,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:34.157695 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:34.162193 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.165865 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 763 time: 0.3317335
May 27 09:38:34.166535 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58376) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:38:34.173141 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Request body: {'security_group_rule': {'security_group_id': 'c16ad23f-ff81-4150-9e90-da0adc4ab56a', 'project_id': '892895f1788940b1bc09406239590e3f', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:34.179077 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:34.183711 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Usage tracker for resource:security_group_rule and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:38:34.187141 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:38:34.194283 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:34.199855 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-0a155b20-e8c7-4309-ac76-7f60015b94e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecf35760>, [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 4, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': 'a2d30df4-18ac-400f-965b-cee83a5de7bd', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'floating_ip_address': '172.27.1.251', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'port_id': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 678, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'mac_address': 'fa:16:3e:e2:9f:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:38:31Z', 'updated_at': '2021-05-27T09:38:31Z', 'revision_number': 0, 'project_id': '892895f1788940b1bc09406239590e3f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c7ac200f-e253-44d5-8112-cc54a37d8ba6', 'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'mac_address': 'fa:16:3e:21:ef:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:39Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 5, 'project_id': '892895f1788940b1bc09406239590e3f', 'subnets': [{'id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:38:34.204954 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0a155b20-e8c7-4309-ac76-7f60015b94e5 None None] The sync data for ids ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'] in dv-cinder-772623-6-iscsi is: [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 4, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': 'a2d30df4-18ac-400f-965b-cee83a5de7bd', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'floating_ip_address': '172.27.1.251', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'port_id': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 678, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'mac_address': 'fa:16:3e:e2:9f:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:38:31Z', 'updated_at': '2021-05-27T09:38:31Z', 'revision_number': 0, 'project_id': '892895f1788940b1bc09406239590e3f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c7ac200f-e253-44d5-8112-cc54a37d8ba6', 'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'mac_address': 'fa:16:3e:21:ef:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:39Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 5, 'project_id': '892895f1788940b1bc09406239590e3f', 'subnets': [{'id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:38:34.212017 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.227858 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a9cdc461-6df3-4757-a177-47108aacd997 req-42b07735-6bdf-4801-9880-a76473bd27b5 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1652496
May 27 09:38:34.282348 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.287052 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.293987 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-fda600ef-9007-4591-891c-9084b9949f11 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:34.316064 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=db397e20-894a-4faa-b896-955f8d0d6869,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:34.318760 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:34.327727 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.331539 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-315ca73b-3e71-422a-b127-953f56acdcb6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 769 time: 0.1614053
May 27 09:38:34.331811 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58380) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:38:34.337489 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.v2.base [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Request body: {'security_group_rule': {'security_group_id': 'c16ad23f-ff81-4150-9e90-da0adc4ab56a', 'project_id': '892895f1788940b1bc09406239590e3f', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91820) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:34.343596 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:34.347564 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Usage tracker for resource:security_group_rule and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:38:34.350846 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.quota.resource [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91820) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:38:34.356901 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.quota.driver [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91820) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:34.368801 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a9cdc461-6df3-4757-a177-47108aacd997 req-e0685ddf-2768-48e1-9ac7-dc3cc49b2710 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1341124
May 27 09:38:34.377411 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.422332 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c8ef9be6-cb5d-4d72-86c5-7fd5b174e7c0 None None] New status for floating IP a2d30df4-18ac-400f-965b-cee83a5de7bd: ACTIVE {{(pid=91823) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:38:34.447762 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.452740 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.454789 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2ce65d7c-9bb3-46a2-ba3c-7c15b7f6aea1 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:34.478383 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8f9e9738-3be1-4579-8f32-945267c153fe,revision_number=0']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:34.483299 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:34.487982 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.492036 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-fcc60731-afe5-4b30-bbb3-f0b75fc7cdc2 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 768 time: 0.1563113
May 27 09:38:34.492513 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58384) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:38:34.499710 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Request body: {'security_group_rule': {'security_group_id': 'c16ad23f-ff81-4150-9e90-da0adc4ab56a', 'project_id': '892895f1788940b1bc09406239590e3f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:34.507723 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:34.513227 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Usage tracker for resource:security_group_rule and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:38:34.518316 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:38:34.524866 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:34.535878 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.securitygroups_db [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Project 892895f1788940b1bc09406239590e3f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 27 09:38:34.541609 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.611419 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.615488 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.618229 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:34.641674 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c34df34e-1d90-4ac5-9105-9f74047760f3,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:34.645900 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:34.654126 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.655799 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-0b6f7d7e-6c51-4a4d-8b92-e9bdadf29d45 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 774 time: 0.1624985
May 27 09:38:34.658758 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58388) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:38:34.664841 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Request body: {'security_group_rule': {'security_group_id': 'c16ad23f-ff81-4150-9e90-da0adc4ab56a', 'project_id': '892895f1788940b1bc09406239590e3f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:34.671789 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom  {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}}
May 27 09:38:34.675425 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Usage tracker for resource:security_group_rule and tenant:892895f1788940b1bc09406239590e3f is out of sync, need to count used quota {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:270}}
May 27 09:38:34.678395 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91821) count_used /opt/stack/neutron/neutron/quota/resource.py:290}}
May 27 09:38:34.685002 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.quota.driver [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91821) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}}
May 27 09:38:34.696677 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.securitygroups_db [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Project 892895f1788940b1bc09406239590e3f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted.
May 27 09:38:34.703707 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.792681 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.797623 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869631'] for security_group_rule, after_create {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.799752 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8b931492-04cd-49cd-872b-f38b45b64238 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:34.828749 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7383217d-a984-4bec-b9bb-742bc7b4a911,revision_number=0']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:34.841202 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.841826 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.842152 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.842545 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.842951 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.843305 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.843725 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.844205 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.844698 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.845371 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.845743 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.846141 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:38:34.851018 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:34.852165 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:34.854009 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-1ca25bdf-c904-4eda-8cc9-a2f92d73eb84 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "POST /v2.0/security-group-rules HTTP/1.1" status: 201  len: 773 time: 0.1938167
May 27 09:38:34.994759 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-fd162e79-b331-47ac-8049-eb27878f4161 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Synchronizing usage tracker for tenant:892895f1788940b1bc09406239590e3f on resource:security_group {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:38:35.012598 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-fd162e79-b331-47ac-8049-eb27878f4161 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Unset dirty status for tenant:892895f1788940b1bc09406239590e3f on resource:security_group {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:38:35.013804 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-fd162e79-b331-47ac-8049-eb27878f4161 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1455814819&fields=id&tenant_id=892895f1788940b1bc09406239590e3f HTTP/1.1" status: 200  len: 267 time: 0.0712299
May 27 09:38:35.203460 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-c4f81f83-4ab6-4979-afce-3febf7e79277 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:35.204968 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-c4f81f83-4ab6-4979-afce-3febf7e79277 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 946 time: 0.1851122
May 27 09:38:35.219745 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-a758057e-ea96-40fa-921e-1c23da8f6c32 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Request body: {'port': {'security_groups': ['b685e495-f031-4397-8903-69c0d36e6321', 'c16ad23f-ff81-4150-9e90-da0adc4ab56a']}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:38:35.354939 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-a758057e-ea96-40fa-921e-1c23da8f6c32 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:35.615121 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-a758057e-ea96-40fa-921e-1c23da8f6c32 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] For port d9fbaf8a-ddda-4038-b9c9-3c246b80818a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:38:35.640227 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-a758057e-ea96-40fa-921e-1c23da8f6c32 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:35.644706 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-a758057e-ea96-40fa-921e-1c23da8f6c32 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:35.650022 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-4a45ed5c-1728-4fb2-a57b-7e7381809c6d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:38:35.656561 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['d9fbaf8a-ddda-4038-b9c9-3c246b80818a'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:38:35.720313 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-a758057e-ea96-40fa-921e-1c23da8f6c32 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:35.720969 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-a758057e-ea96-40fa-921e-1c23da8f6c32 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:35.722360 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-ef505948-e4aa-4559-97ae-25b46a9c7976 req-a758057e-ea96-40fa-921e-1c23da8f6c32 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "PUT /v2.0/ports/d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 200  len: 982 time: 0.5098741
May 27 09:38:35.722891 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:38:35.766848 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a758057e-ea96-40fa-921e-1c23da8f6c32 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'Port': ['ID=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,revision_number=6']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:38:35.771780 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a758057e-ea96-40fa-921e-1c23da8f6c32 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:38:35.791420 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'status': 'completed', 'code': 200}
May 27 09:38:35.793424 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['d9fbaf8a-ddda-4038-b9c9-3c246b80818a'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:38:35.977745 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10699d1f-0790-4fc0-89ed-32b825ae34ad req-460ed37e-5e92-4961-8fa1-44966ebfc9d0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:35.979267 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10699d1f-0790-4fc0-89ed-32b825ae34ad req-460ed37e-5e92-4961-8fa1-44966ebfc9d0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.1284280
May 27 09:38:35.982202 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24457ec-12af-4f28-8512-59098450d1ed req-fa2deb11-c810-4953-aef2-b1f64a180609 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:35.984127 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d24457ec-12af-4f28-8512-59098450d1ed req-fa2deb11-c810-4953-aef2-b1f64a180609 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=892895f1788940b1bc09406239590e3f&device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 1138 time: 0.1716602
May 27 09:38:36.018312 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-a84fdafc-5af7-4a1b-9a54-189bcdddbd28 None None] Provisioning complete for port d9fbaf8a-ddda-4038-b9c9-3c246b80818a triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:38:36.018690 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a84fdafc-5af7-4a1b-9a54-189bcdddbd28 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:36.112004 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-10699d1f-0790-4fc0-89ed-32b825ae34ad req-04a6474a-d56e-4b3e-8edc-19eddc3f925e tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1264625
May 27 09:38:36.160057 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24457ec-12af-4f28-8512-59098450d1ed req-ee6f8c3b-0b6a-4144-8f56-3679d66f3efa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:36.161408 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d24457ec-12af-4f28-8512-59098450d1ed req-ee6f8c3b-0b6a-4144-8f56-3679d66f3efa service neutron] 10.222.0.11 "GET /v2.0/networks?id=8969d19b-2ae2-4dd6-9861-e28e315bba3f HTTP/1.1" status: 200  len: 915 time: 0.1624570
May 27 09:38:36.266191 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d24457ec-12af-4f28-8512-59098450d1ed req-a15b01d0-61bc-4652-b00a-b03232e0450d service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 200  len: 1002 time: 0.0978913
May 27 09:38:36.351798 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24457ec-12af-4f28-8512-59098450d1ed req-cfcf7670-7f00-430c-9970-4c6863cfd1ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:36.353264 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d24457ec-12af-4f28-8512-59098450d1ed req-cfcf7670-7f00-430c-9970-4c6863cfd1ff service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c1677eac-45e9-4a22-9a63-044a5ded43ac HTTP/1.1" status: 200  len: 853 time: 0.0714712
May 27 09:38:36.433164 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d24457ec-12af-4f28-8512-59098450d1ed req-2b8501d3-50ee-4b11-9608-36a6e8c167c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:36.434633 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d24457ec-12af-4f28-8512-59098450d1ed req-2b8501d3-50ee-4b11-9608-36a6e8c167c0 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=8969d19b-2ae2-4dd6-9861-e28e315bba3f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0704412
May 27 09:38:36.567111 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d24457ec-12af-4f28-8512-59098450d1ed req-6ae0e526-f116-43a4-91f0-8d1554ba843d service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1247275
May 27 09:38:36.703404 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d24457ec-12af-4f28-8512-59098450d1ed req-2fd9c666-84d7-4c0d-9877-f62a791477b2 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1290836
May 27 09:38:38.528012 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d2ff169f-9544-4210-bcd0-626d1ee67f39 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:39.103994 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:38:41.475696 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:41.831820 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e9378cdc-15b7-4845-ba19-9a2fd72f1234 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:42.401456 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:44.948563 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:56.500620 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:38:58.870885 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60cc2903-0e40-47ee-bec5-37d23a489718 req-238fc8f9-bc0d-46f6-a381-0e7a517fc793 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:58.872333 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-60cc2903-0e40-47ee-bec5-37d23a489718 req-238fc8f9-bc0d-46f6-a381-0e7a517fc793 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=892895f1788940b1bc09406239590e3f&device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 1138 time: 0.1357992
May 27 09:38:58.880686 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbfb3580-44a0-4894-a49d-f800c5b64456 req-468e432d-79dc-4056-ae86-b49e8139395c tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:58.882046 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bbfb3580-44a0-4894-a49d-f800c5b64456 req-468e432d-79dc-4056-ae86-b49e8139395c tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.1115210
May 27 09:38:59.096425 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-bbfb3580-44a0-4894-a49d-f800c5b64456 req-f2f6ec79-53c5-44d4-81b5-d92dea2a9841 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.1955814
May 27 09:38:59.131122 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60cc2903-0e40-47ee-bec5-37d23a489718 req-a6bb55d0-9259-4435-83ae-df3c7fde5355 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:59.132531 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-60cc2903-0e40-47ee-bec5-37d23a489718 req-a6bb55d0-9259-4435-83ae-df3c7fde5355 service neutron] 10.222.0.11 "GET /v2.0/networks?id=8969d19b-2ae2-4dd6-9861-e28e315bba3f HTTP/1.1" status: 200  len: 915 time: 0.2496619
May 27 09:38:59.236518 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-60cc2903-0e40-47ee-bec5-37d23a489718 req-343ace25-0f4d-44c6-adb7-2b02b0c203e4 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 200  len: 1002 time: 0.0969434
May 27 09:38:59.301259 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60cc2903-0e40-47ee-bec5-37d23a489718 req-f99c9578-ff00-46a7-af20-5646ab9cc765 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:59.302651 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-60cc2903-0e40-47ee-bec5-37d23a489718 req-f99c9578-ff00-46a7-af20-5646ab9cc765 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c1677eac-45e9-4a22-9a63-044a5ded43ac HTTP/1.1" status: 200  len: 853 time: 0.0590408
May 27 09:38:59.378550 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60cc2903-0e40-47ee-bec5-37d23a489718 req-59ad16a8-afb7-4d86-ab1f-35ceb41292bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:38:59.380168 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-60cc2903-0e40-47ee-bec5-37d23a489718 req-59ad16a8-afb7-4d86-ab1f-35ceb41292bd service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=8969d19b-2ae2-4dd6-9861-e28e315bba3f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0708215
May 27 09:38:59.509854 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-60cc2903-0e40-47ee-bec5-37d23a489718 req-c3560451-2ede-47cf-b4ac-89cec72733e6 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1229217
May 27 09:38:59.641195 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-60cc2903-0e40-47ee-bec5-37d23a489718 req-f598ad56-f696-4f57-aec3-396d41d6aeac service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1242628
May 27 09:39:00.285882 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44bd28ff-1216-4b75-affa-b68d13956843 req-a629c322-5b8e-45b8-a110-d64fc17f65fa tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:00.287343 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-44bd28ff-1216-4b75-affa-b68d13956843 req-a629c322-5b8e-45b8-a110-d64fc17f65fa tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0790946
May 27 09:39:00.340573 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-44bd28ff-1216-4b75-affa-b68d13956843 req-680bb294-7365-4824-87e1-1a2ac6030367 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0474005
May 27 09:39:01.531845 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd07e7db-f441-4432-9a75-3dd16fe50bfb req-fe986e14-86d4-47bd-bc4c-231a82877053 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:01.533568 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cd07e7db-f441-4432-9a75-3dd16fe50bfb req-fe986e14-86d4-47bd-bc4c-231a82877053 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0880206
May 27 09:39:01.586910 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cd07e7db-f441-4432-9a75-3dd16fe50bfb req-337e94bf-0664-4ab3-be8a-fc96b4eff811 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0476203
May 27 09:39:02.774415 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e96dc5f8-6516-4638-bfb3-939e5d69f06b req-e4a7ad22-2429-4eaf-974a-c071019d9f8a tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:02.775977 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e96dc5f8-6516-4638-bfb3-939e5d69f06b req-e4a7ad22-2429-4eaf-974a-c071019d9f8a tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0839026
May 27 09:39:02.823780 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-e96dc5f8-6516-4638-bfb3-939e5d69f06b req-7b7e5877-fd01-4514-b211-10d4efbb7adf tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0420432
May 27 09:39:04.008765 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b80543a1-8885-45ae-90dc-47e132034dcf req-234d8ce0-4100-4bcf-bf7f-74b187109c70 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:04.010145 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b80543a1-8885-45ae-90dc-47e132034dcf req-234d8ce0-4100-4bcf-bf7f-74b187109c70 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0807281
May 27 09:39:04.058002 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-b80543a1-8885-45ae-90dc-47e132034dcf req-16d08ee2-ecea-494e-91a4-bd21daab482c tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0414774
May 27 09:39:05.250545 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6909f407-1e0a-4d8b-ba81-cbe03f61ed98 req-e7068826-faf4-4e22-9eaf-94d5dab8b1da tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:05.252041 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6909f407-1e0a-4d8b-ba81-cbe03f61ed98 req-e7068826-faf4-4e22-9eaf-94d5dab8b1da tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0858200
May 27 09:39:05.299546 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6909f407-1e0a-4d8b-ba81-cbe03f61ed98 req-7f44ea3d-c6f7-4967-bba6-9f2d6799297c tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0417733
May 27 09:39:06.484986 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d449fd4-0330-4ccc-88ae-837e452aab64 req-08c0ffbf-be1c-48e1-98c0-7b14b0fe6b6a tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:06.486448 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6d449fd4-0330-4ccc-88ae-837e452aab64 req-08c0ffbf-be1c-48e1-98c0-7b14b0fe6b6a tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0810311
May 27 09:39:06.535918 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-6d449fd4-0330-4ccc-88ae-837e452aab64 req-42701dda-a059-41d6-9cea-bac24eca6c1e tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0437810
May 27 09:39:07.722339 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f581da1-0760-4d81-ae6a-2244c0209279 req-2e86ae47-1dec-49f1-baac-fcd4c372b059 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:07.724063 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3f581da1-0760-4d81-ae6a-2244c0209279 req-2e86ae47-1dec-49f1-baac-fcd4c372b059 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0816438
May 27 09:39:07.772593 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3f581da1-0760-4d81-ae6a-2244c0209279 req-e61c3b27-8ab8-4a1d-a059-0f87832e7b6d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0428483
May 27 09:39:08.530201 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-9d617d33-6f9d-410f-b501-0afc738aa1b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:08.960447 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f3bb0bb-e703-40de-a595-a9537ee93e54 req-720d52b9-8f2e-42ae-8070-49a6cd48b78b tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:08.961907 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5f3bb0bb-e703-40de-a595-a9537ee93e54 req-720d52b9-8f2e-42ae-8070-49a6cd48b78b tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0849922
May 27 09:39:09.007942 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-5f3bb0bb-e703-40de-a595-a9537ee93e54 req-f36ff11b-db48-48b7-ae36-5553f948f954 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0402935
May 27 09:39:10.194532 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a05e697b-a614-4d97-9182-0b59e05688b0 req-cc72d48b-bc13-4afb-b179-a24540412240 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:10.196016 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a05e697b-a614-4d97-9182-0b59e05688b0 req-cc72d48b-bc13-4afb-b179-a24540412240 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0821705
May 27 09:39:10.244317 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a05e697b-a614-4d97-9182-0b59e05688b0 req-b6c801c4-f687-4225-ba9d-203a515cb9e4 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0425682
May 27 09:39:11.432272 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3ac6a0c-7ef3-4370-b418-6947b8d14fed req-ef9f9e53-4ce9-46cb-aa64-db8b5439b1f3 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:11.433758 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f3ac6a0c-7ef3-4370-b418-6947b8d14fed req-ef9f9e53-4ce9-46cb-aa64-db8b5439b1f3 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0865886
May 27 09:39:11.470102 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:11.485693 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f3ac6a0c-7ef3-4370-b418-6947b8d14fed req-d9bbd9ca-7b09-4768-9ab5-c31c14e5b119 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0450785
May 27 09:39:11.834009 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e2fd252c-15ea-4ea0-a95d-652239fe2bc6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:12.404611 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:12.676538 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fb33197-0614-4690-85ae-4aa8c090cd78 req-b1c6ddf5-d0ea-403f-9cf7-321ec316958f tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:12.678068 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1fb33197-0614-4690-85ae-4aa8c090cd78 req-b1c6ddf5-d0ea-403f-9cf7-321ec316958f tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0835598
May 27 09:39:12.729076 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1fb33197-0614-4690-85ae-4aa8c090cd78 req-5097f9f2-4b64-4c10-8268-c35bd024b5fe tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0452094
May 27 09:39:14.003944 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3db8c854-649a-40ed-9215-6ce607cacb8a req-f3d9cce5-13c1-4acd-bac8-6febb250b59a tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:14.005334 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3db8c854-649a-40ed-9215-6ce607cacb8a req-f3d9cce5-13c1-4acd-bac8-6febb250b59a tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.1666775
May 27 09:39:14.052864 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3db8c854-649a-40ed-9215-6ce607cacb8a req-b6d7122d-4a9c-40b9-b41a-aafadf81f93b tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0418217
May 27 09:39:14.953351 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:15.239110 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78ad6810-46bc-466e-adfc-c8810b230672 req-2bf7db5a-c815-47b4-83b9-ece3cf77d908 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:15.240595 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-78ad6810-46bc-466e-adfc-c8810b230672 req-2bf7db5a-c815-47b4-83b9-ece3cf77d908 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0833383
May 27 09:39:15.286798 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-78ad6810-46bc-466e-adfc-c8810b230672 req-7102d289-b4c4-446f-a3ae-c2881ce7496f tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0404603
May 27 09:39:16.103068 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:39:16.488663 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e7ed6c8-8408-4a39-8f47-d204d4312db0 req-4601976c-5c39-40d9-80fe-1025d481bfef tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:16.490134 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4e7ed6c8-8408-4a39-8f47-d204d4312db0 req-4601976c-5c39-40d9-80fe-1025d481bfef tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0794432
May 27 09:39:16.541341 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4e7ed6c8-8408-4a39-8f47-d204d4312db0 req-519610fd-8d20-4e03-94e5-cc67fc59c686 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=c16ad23f-ff81-4150-9e90-da0adc4ab56a&id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 380 time: 0.0454931
May 27 09:39:26.504600 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:32.893157 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-6d894bd2-4eb0-4832-afd1-e41366b3ed82 service neutron] 10.222.0.11 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200  len: 275 time: 0.0739446
May 27 09:39:32.983480 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-3f1183d5-ec2b-4803-9d5f-6895a2425417 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:32.985113 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-3f1183d5-ec2b-4803-9d5f-6895a2425417 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=892895f1788940b1bc09406239590e3f&device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 1138 time: 0.0709019
May 27 09:39:33.133198 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-226f667a-f8c6-4b79-93b9-4e0b3ffa2508 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:33.134648 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-226f667a-f8c6-4b79-93b9-4e0b3ffa2508 service neutron] 10.222.0.11 "GET /v2.0/networks?id=8969d19b-2ae2-4dd6-9861-e28e315bba3f HTTP/1.1" status: 200  len: 915 time: 0.1304455
May 27 09:39:33.238228 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-143d8d54-ef50-4034-88a7-47ed5ce927ca service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 200  len: 1002 time: 0.0967224
May 27 09:39:33.303355 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-9879bc07-6a17-41c0-b96d-0923050b2e14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:33.304797 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-9879bc07-6a17-41c0-b96d-0923050b2e14 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c1677eac-45e9-4a22-9a63-044a5ded43ac HTTP/1.1" status: 200  len: 853 time: 0.0606563
May 27 09:39:33.381767 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-c3505e02-d5d6-4493-8644-d77b63607668 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:33.383247 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-c3505e02-d5d6-4493-8644-d77b63607668 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=8969d19b-2ae2-4dd6-9861-e28e315bba3f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0720327
May 27 09:39:33.532719 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-85b14fc7-c9b1-4791-8468-5f90445ff916 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1424439
May 27 09:39:33.664471 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-f6d2541c-671a-4b8a-a5c5-5d7b506cd912 req-08fec220-02a1-4af6-9471-96a754144bf6 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1232445
May 27 09:39:38.535709 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ce138da-0318-460c-984b-e2f4d300ac60 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:41.465638 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:41.836901 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-ff835423-7ad0-4099-a3e0-fcd41e61e51e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:42.407598 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:44.955903 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:49.838818 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4fae9c1c-2618-4909-bf0d-9117cbf33489 req-1477d812-0cba-49da-816a-dfe3a92c49f6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1455814819&fields=id&tenant_id=892895f1788940b1bc09406239590e3f HTTP/1.1" status: 200  len: 267 time: 0.0400476
May 27 09:39:49.926999 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fae9c1c-2618-4909-bf0d-9117cbf33489 req-31055505-ee2e-48fd-8e34-872d9afb5b02 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:49.928475 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4fae9c1c-2618-4909-bf0d-9117cbf33489 req-31055505-ee2e-48fd-8e34-872d9afb5b02 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 985 time: 0.0844564
May 27 09:39:49.939811 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.v2.base [req-4fae9c1c-2618-4909-bf0d-9117cbf33489 req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Request body: {'port': {'security_groups': ['b685e495-f031-4397-8903-69c0d36e6321']}} {{(pid=91821) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}}
May 27 09:39:50.057818 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4fae9c1c-2618-4909-bf0d-9117cbf33489 req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-770852'] for port, before_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:50.292006 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-4fae9c1c-2618-4909-bf0d-9117cbf33489 req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] For port d9fbaf8a-ddda-4038-b9c9-3c246b80818a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:39:50.315508 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4fae9c1c-2618-4909-bf0d-9117cbf33489 req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for port, precommit_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:50.320021 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4fae9c1c-2618-4909-bf0d-9117cbf33489 req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8739971492235', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8739971057125', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8739971057686', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-2157359'] for port, after_update {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:50.326069 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-f0f64b66-ce0d-4832-a5a9-effe0c63f080 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:39:50.332865 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['d9fbaf8a-ddda-4038-b9c9-3c246b80818a'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:39:50.493566 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fae9c1c-2618-4909-bf0d-9117cbf33489 req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:50.494206 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-4fae9c1c-2618-4909-bf0d-9117cbf33489 req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:50.495621 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-4fae9c1c-2618-4909-bf0d-9117cbf33489 req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "PUT /v2.0/ports/d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 200  len: 943 time: 0.5610499
May 27 09:39:50.496371 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:39:50.502250 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58474) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:39:50.514893 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event updated for resources: {'Port': ['ID=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,revision_number=7']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:39:50.522695 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.523079 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.523492 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.523863 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.524224 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.524586 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.524943 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.525300 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.525651 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.526001 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.526455 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.526691 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91821) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.530610 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.205s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:39:50.568386 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'status': 'completed', 'code': 200}
May 27 09:39:50.585901 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['d9fbaf8a-ddda-4038-b9c9-3c246b80818a'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:39:50.608268 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:50.642930 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:50.669720 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0dd21a1-1b3a-488f-835a-d9975d77921e req-26be502a-6328-48ea-b95b-dbad587ee265 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:50.671321 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a0dd21a1-1b3a-488f-835a-d9975d77921e req-26be502a-6328-48ea-b95b-dbad587ee265 service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=892895f1788940b1bc09406239590e3f&device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 1099 time: 0.0809860
May 27 09:39:50.719314 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:50.726049 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-790467eb-b91a-494c-8c26-ac216cf58c8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:39:50.741143 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c16ad23f-ff81-4150-9e90-da0adc4ab56a,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:39:50.750125 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.750509 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.750948 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.751328 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.751725 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.752100 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.752471 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.752838 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.753219 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.753569 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.753932 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.754296 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91820) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:39:50.761545 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:39:50.762377 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:50.763523 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-2484be4f-0dd5-4286-936b-20011fae03df tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "DELETE /v2.0/security-groups/c16ad23f-ff81-4150-9e90-da0adc4ab56a HTTP/1.1" status: 204  len: 168 time: 0.2602077
May 27 09:39:50.766075 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58478) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:39:50.820805 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0dd21a1-1b3a-488f-835a-d9975d77921e req-14678d22-4f1d-463c-8d85-6e8aed818b22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:50.822246 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a0dd21a1-1b3a-488f-835a-d9975d77921e req-14678d22-4f1d-463c-8d85-6e8aed818b22 service neutron] 10.222.0.11 "GET /v2.0/networks?id=8969d19b-2ae2-4dd6-9861-e28e315bba3f HTTP/1.1" status: 200  len: 915 time: 0.1427495
May 27 09:39:50.822630 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.provisioning_blocks [None req-3fd5810d-dd4c-40c6-a1cf-4b9a85d0481d None None] Provisioning complete for port d9fbaf8a-ddda-4038-b9c9-3c246b80818a triggered by entity DHCP. {{(pid=91822) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}}
May 27 09:39:50.823041 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3fd5810d-dd4c-40c6-a1cf-4b9a85d0481d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-860138'] for port, provisioning_complete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:50.931820 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a0dd21a1-1b3a-488f-835a-d9975d77921e req-709a93a8-5c91-4092-8ba3-1ec236c3aff9 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 200  len: 1002 time: 0.1025577
May 27 09:39:50.999486 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0dd21a1-1b3a-488f-835a-d9975d77921e req-16ba8a4b-58fb-49f3-aac1-c778ea5364ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:51.001533 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a0dd21a1-1b3a-488f-835a-d9975d77921e req-16ba8a4b-58fb-49f3-aac1-c778ea5364ea service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c1677eac-45e9-4a22-9a63-044a5ded43ac HTTP/1.1" status: 200  len: 853 time: 0.0617211
May 27 09:39:51.083075 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0dd21a1-1b3a-488f-835a-d9975d77921e req-8694b973-6257-4972-901c-486e3510a7cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:51.084504 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a0dd21a1-1b3a-488f-835a-d9975d77921e req-8694b973-6257-4972-901c-486e3510a7cc service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=8969d19b-2ae2-4dd6-9861-e28e315bba3f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0767632
May 27 09:39:51.169528 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Deleting port c7a70175-2d7b-4d8f-9169-4306c5f6843c {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:39:51.169953 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:51.219284 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a0dd21a1-1b3a-488f-835a-d9975d77921e req-25e49981-f3cd-449b-a36e-dd237d40e2ea service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1282177
May 27 09:39:51.293029 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:51.293368 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:51.351747 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a0dd21a1-1b3a-488f-835a-d9975d77921e req-45656895-ff46-4a67-946c-9e85e1489b03 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1261735
May 27 09:39:51.424238 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Calling delete_port for c7a70175-2d7b-4d8f-9169-4306c5f6843c owned by network:floatingip {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:39:51.551020 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:51.554548 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-e578f8f9-a4b2-4860-8559-ff7c05a44a97 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:39:51.599126 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event deleted for resources: {'Port': ['ID=c7a70175-2d7b-4d8f-9169-4306c5f6843c,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:39:51.602336 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:39:51.692816 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks [] for floatingip, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:51.693149 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.db.l3_db [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Floating IP a2d30df4-18ac-400f-965b-cee83a5de7bd disassociated (deleted). External IP: 172.27.1.251, port: d9fbaf8a-ddda-4038-b9c9-3c246b80818a.
May 27 09:39:52.043379 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:39:52.222172 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:39:52.231648 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-231f8e11-1b52-4fbb-8692-908f20597f0a None None] Sync routers for ids ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:39:52.234932 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:52.241177 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-231f8e11-1b52-4fbb-8692-908f20597f0a None None] Routers {'15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:39:52.241798 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-231f8e11-1b52-4fbb-8692-908f20597f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed009250>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:39:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:39:52.292106 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-7285cf51-6131-4181-8689-04c4391ae1a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "DELETE /v2.0/floatingips/a2d30df4-18ac-400f-965b-cee83a5de7bd HTTP/1.1" status: 204  len: 168 time: 1.5244157
May 27 09:39:52.292740 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a'}] {{(pid=91820) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:39:52.339602 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'status': 'completed', 'code': 200}
May 27 09:39:52.427030 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-231f8e11-1b52-4fbb-8692-908f20597f0a None None] Set router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:39:52.434978 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3faecf65-ec89-48f4-8d6f-4c2fd744896a req-b961ce07-256c-405b-a532-0a9e0755da7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:52.436513 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3faecf65-ec89-48f4-8d6f-4c2fd744896a req-b961ce07-256c-405b-a532-0a9e0755da7f service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=892895f1788940b1bc09406239590e3f&device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 1099 time: 0.0735352
May 27 09:39:52.572936 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3faecf65-ec89-48f4-8d6f-4c2fd744896a req-c024f33b-c2e5-47d3-b7b5-676751d2d144 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:52.574337 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3faecf65-ec89-48f4-8d6f-4c2fd744896a req-c024f33b-c2e5-47d3-b7b5-676751d2d144 service neutron] 10.222.0.11 "GET /v2.0/networks?id=8969d19b-2ae2-4dd6-9861-e28e315bba3f HTTP/1.1" status: 200  len: 915 time: 0.1309874
May 27 09:39:52.654282 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3faecf65-ec89-48f4-8d6f-4c2fd744896a req-2bd15181-7a15-43fd-982c-6fcbb7733db8 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 200  len: 217 time: 0.0735161
May 27 09:39:52.727002 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3faecf65-ec89-48f4-8d6f-4c2fd744896a req-0c0e68ef-be77-421a-ab04-72845d08f5fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:52.728700 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3faecf65-ec89-48f4-8d6f-4c2fd744896a req-0c0e68ef-be77-421a-ab04-72845d08f5fe service neutron] 10.222.0.11 "GET /v2.0/subnets?id=c1677eac-45e9-4a22-9a63-044a5ded43ac HTTP/1.1" status: 200  len: 853 time: 0.0666282
May 27 09:39:52.784031 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-231f8e11-1b52-4fbb-8692-908f20597f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed009250>, [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 4, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c7ac200f-e253-44d5-8112-cc54a37d8ba6', 'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'mac_address': 'fa:16:3e:21:ef:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:39Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 5, 'project_id': '892895f1788940b1bc09406239590e3f', 'subnets': [{'id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:39:52.788293 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-231f8e11-1b52-4fbb-8692-908f20597f0a None None] Checking router: 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:39:52.796948 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-231f8e11-1b52-4fbb-8692-908f20597f0a None None] Routers {'15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:39:52.797734 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-231f8e11-1b52-4fbb-8692-908f20597f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eed009250>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:39:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:39:52.808599 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3faecf65-ec89-48f4-8d6f-4c2fd744896a req-1dad16c6-1dd8-4596-81a5-23a1c59f9f4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:52.810087 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3faecf65-ec89-48f4-8d6f-4c2fd744896a req-1dad16c6-1dd8-4596-81a5-23a1c59f9f4c service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=8969d19b-2ae2-4dd6-9861-e28e315bba3f&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.0752892
May 27 09:39:52.948390 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3faecf65-ec89-48f4-8d6f-4c2fd744896a req-7ed62472-8eed-4081-82a1-11140e0df629 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1292057
May 27 09:39:53.015930 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-231f8e11-1b52-4fbb-8692-908f20597f0a None None] Set router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:39:53.080663 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-3faecf65-ec89-48f4-8d6f-4c2fd744896a req-9b56bca3-36f8-41a0-85c9-bff322dbf802 service neutron] 10.222.0.11 "GET /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1252077
May 27 09:39:53.104246 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:39:53.332763 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-231f8e11-1b52-4fbb-8692-908f20597f0a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eed009250>, [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 4, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c7ac200f-e253-44d5-8112-cc54a37d8ba6', 'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'mac_address': 'fa:16:3e:21:ef:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:39Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 5, 'project_id': '892895f1788940b1bc09406239590e3f', 'subnets': [{'id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:39:53.336824 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-231f8e11-1b52-4fbb-8692-908f20597f0a None None] The sync data for ids ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'] in dv-cinder-772623-6-iscsi is: [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:37:40Z', 'revision_number': 4, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': 'c7ac200f-e253-44d5-8112-cc54a37d8ba6', 'name': '', 'network_id': '8969d19b-2ae2-4dd6-9861-e28e315bba3f', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'mac_address': 'fa:16:3e:21:ef:c0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_interface', 'standard_attr_id': 660, 'fixed_ips': [{'subnet_id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:39Z', 'updated_at': '2021-05-27T09:37:47Z', 'revision_number': 5, 'project_id': '892895f1788940b1bc09406239590e3f', 'subnets': [{'id': 'c1677eac-45e9-4a22-9a63-044a5ded43ac', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:39:53.549285 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-78ef1b15-1a04-470d-9332-d35772d1518a None None] New status for floating IP a2d30df4-18ac-400f-965b-cee83a5de7bd: DOWN {{(pid=91823) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:39:55.605851 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c09b817-7c95-4c9a-83a0-e267c4ddb40a req-40101054-f9dc-4439-820e-fee350bb33a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:55.607309 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9c09b817-7c95-4c9a-83a0-e267c4ddb40a req-40101054-f9dc-4439-820e-fee350bb33a6 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 946 time: 0.0815966
May 27 09:39:55.652323 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-9c09b817-7c95-4c9a-83a0-e267c4ddb40a req-b6af0417-f1c6-406b-83be-1248da8dff47 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0385497
May 27 09:39:56.516085 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:57.136001 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ccc3cab-29e5-4ebe-ac43-3b98438c7379 req-571ee8a9-db03-41a4-848a-d3ad18b428a5 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:57.137458 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7ccc3cab-29e5-4ebe-ac43-3b98438c7379 req-571ee8a9-db03-41a4-848a-d3ad18b428a5 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 946 time: 0.2336340
May 27 09:39:57.194117 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9b97e88-2cc1-46b0-a771-77f08c9f12d8 req-b8c84f65-1e24-4a64-a63a-de1d14cf375e tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:39:57.195581 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d9b97e88-2cc1-46b0-a771-77f08c9f12d8 req-b8c84f65-1e24-4a64-a63a-de1d14cf375e tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.11 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 946 time: 0.1345344
May 27 09:39:57.202430 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-7ccc3cab-29e5-4ebe-ac43-3b98438c7379 req-cdd99c95-749b-4c9e-8908-1349f1c33ca0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/security-groups?id=b685e495-f031-4397-8903-69c0d36e6321&fields=id&fields=name HTTP/1.1" status: 200  len: 286 time: 0.0590389
May 27 09:39:57.335286 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-d9b97e88-2cc1-46b0-a771-77f08c9f12d8 req-b4565b3b-cff3-4a61-8239-7dad2e40b4e0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Deleting port d9fbaf8a-ddda-4038-b9c9-3c246b80818a {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:39:57.335665 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d9b97e88-2cc1-46b0-a771-77f08c9f12d8 req-b4565b3b-cff3-4a61-8239-7dad2e40b4e0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:57.486285 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-d9b97e88-2cc1-46b0-a771-77f08c9f12d8 req-b4565b3b-cff3-4a61-8239-7dad2e40b4e0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] For port d9fbaf8a-ddda-4038-b9c9-3c246b80818a, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:39:57.486691 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d9b97e88-2cc1-46b0-a771-77f08c9f12d8 req-b4565b3b-cff3-4a61-8239-7dad2e40b4e0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:57.624089 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-d9b97e88-2cc1-46b0-a771-77f08c9f12d8 req-b4565b3b-cff3-4a61-8239-7dad2e40b4e0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Calling delete_port for d9fbaf8a-ddda-4038-b9c9-3c246b80818a owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:39:57.735924 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d9b97e88-2cc1-46b0-a771-77f08c9f12d8 req-b4565b3b-cff3-4a61-8239-7dad2e40b4e0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:57.741417 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-1b63cb09-d140-427a-b74b-ec1acab162e0 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:39:57.747089 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] get_ports_and_sgs() called for port_ids ['d9fbaf8a-ddda-4038-b9c9-3c246b80818a'] {{(pid=91822) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}}
May 27 09:39:57.786581 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4565b3b-cff3-4a61-8239-7dad2e40b4e0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Pushing event deleted for resources: {'Port': ['ID=d9fbaf8a-ddda-4038-b9c9-3c246b80818a,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:39:57.792431 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-b4565b3b-cff3-4a61-8239-7dad2e40b4e0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:39:57.874070 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-d9b97e88-2cc1-46b0-a771-77f08c9f12d8 req-b4565b3b-cff3-4a61-8239-7dad2e40b4e0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] No DVR routers for this DVR port d9fbaf8a-ddda-4038-b9c9-3c246b80818a on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:39:57.876719 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-d9b97e88-2cc1-46b0-a771-77f08c9f12d8 req-b4565b3b-cff3-4a61-8239-7dad2e40b4e0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:39:57.879242 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'name': 'network-vif-deleted', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:39:57.887106 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d9b97e88-2cc1-46b0-a771-77f08c9f12d8 req-b4565b3b-cff3-4a61-8239-7dad2e40b4e0 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.11 "DELETE /v2.0/ports/d9fbaf8a-ddda-4038-b9c9-3c246b80818a HTTP/1.1" status: 204  len: 173 time: 0.6837893
May 27 09:39:57.927556 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b4553486-d7aa-4bdb-ace9-1d5e470c7947', 'name': 'network-vif-deleted', 'tag': 'd9fbaf8a-ddda-4038-b9c9-3c246b80818a', 'status': 'completed', 'code': 200}
May 27 09:39:58.363248 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-13ce2a24-4844-4415-8ba2-e109ed2f4f64 req-5d3a2d32-d0d5-4e78-a224-fe63d14a406d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Synchronizing usage tracker for tenant:892895f1788940b1bc09406239590e3f on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:39:58.380028 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-13ce2a24-4844-4415-8ba2-e109ed2f4f64 req-5d3a2d32-d0d5-4e78-a224-fe63d14a406d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Unset dirty status for tenant:892895f1788940b1bc09406239590e3f on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:39:58.381100 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-13ce2a24-4844-4415-8ba2-e109ed2f4f64 req-5d3a2d32-d0d5-4e78-a224-fe63d14a406d tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] 10.222.0.30 "GET /v2.0/ports?device_id=b4553486-d7aa-4bdb-ace9-1d5e470c7947 HTTP/1.1" status: 200  len: 210 time: 0.0603504
May 27 09:40:00.073803 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58560) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:00.607478 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3816697'] for router_interface, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:00.894548 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device d9fbaf8a-ddda-4038-b9c9-3c246b80818a no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:00.930273 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: d9fbaf8a-ddda-4038-b9c9-3c246b80818a {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:00.930637 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device d9fbaf8a-ddda-4038-b9c9-3c246b80818a not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:01.113268 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] Deleting port c7ac200f-e253-44d5-8112-cc54a37d8ba6 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:01.113870 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:01.236882 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] For port c7ac200f-e253-44d5-8112-cc54a37d8ba6, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=c7ac200f-e253-44d5-8112-cc54a37d8ba6,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:01.237242 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:01.364355 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] Calling delete_port for c7ac200f-e253-44d5-8112-cc54a37d8ba6 owned by network:router_interface {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:01.521262 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:01.525762 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-9fc350de-7dfd-423c-9dc7-72901634102b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:01.569630 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] Pushing event deleted for resources: {'Port': ['ID=c7ac200f-e253-44d5-8112-cc54a37d8ba6,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:01.605840 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:01.841338 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3683824', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3812169'] for router_interface, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:02.312543 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] Router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:40:02.494524 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:40:02.504271 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66c6d54e-32b1-4244-8d3a-5f4d39d06dda None None] Sync routers for ids ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:40:02.514087 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-73242674-a8cd-4ba4-ab86-ad4512afd24e admin admin] 10.222.0.30 "PUT /v2.0/routers/15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4369466
May 27 09:40:02.514339 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66c6d54e-32b1-4244-8d3a-5f4d39d06dda None None] Routers {'15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:02.514339 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-66c6d54e-32b1-4244-8d3a-5f4d39d06dda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec883220>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:39:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:02.514553 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58564) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:02.694729 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-66c6d54e-32b1-4244-8d3a-5f4d39d06dda None None] Set router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:02.712310 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Notify callbacks [] for router, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:02.885375 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:02.965289 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Deleting port 63e2bf20-0d18-46a4-9d87-4773d39f55c2 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:02.965631 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:02.991381 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-66c6d54e-32b1-4244-8d3a-5f4d39d06dda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec883220>, [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180'}], 'enable_snat': True}, 'gw_port_id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:40:01Z', 'revision_number': 5, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port': {'id': '63e2bf20-0d18-46a4-9d87-4773d39f55c2', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:fa:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 659, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.180', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:37Z', 'updated_at': '2021-05-27T09:37:42Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:02.995602 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66c6d54e-32b1-4244-8d3a-5f4d39d06dda None None] Checking router: 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:40:03.004990 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66c6d54e-32b1-4244-8d3a-5f4d39d06dda None None] Routers {'15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:03.005695 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-66c6d54e-32b1-4244-8d3a-5f4d39d06dda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eec883220>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:39:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:03.087501 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] For port 63e2bf20-0d18-46a4-9d87-4773d39f55c2, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=63e2bf20-0d18-46a4-9d87-4773d39f55c2,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:03.087861 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:03.159243 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-66c6d54e-32b1-4244-8d3a-5f4d39d06dda None None] Set router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 gateway port host: None {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:03.209462 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Calling delete_port for 63e2bf20-0d18-46a4-9d87-4773d39f55c2 owned by network:router_gateway {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:03.269974 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-66c6d54e-32b1-4244-8d3a-5f4d39d06dda None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eec883220>, [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:40:02Z', 'revision_number': 6, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port_host': None}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:03.274042 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66c6d54e-32b1-4244-8d3a-5f4d39d06dda None None] The sync data for ids ['15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05'] in dv-cinder-772623-6-iscsi is: [{'id': '15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05', 'name': 'tempest-TestMinimumBasicScenario-654171515-router', 'tenant_id': '892895f1788940b1bc09406239590e3f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:36Z', 'updated_at': '2021-05-27T09:40:02Z', 'revision_number': 6, 'project_id': '892895f1788940b1bc09406239590e3f', 'gw_port_host': None}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:40:03.354118 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:03.357715 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-879bcbda-0e69-4754-a6e2-886ca6144201 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:03.399852 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Pushing event deleted for resources: {'Port': ['ID=63e2bf20-0d18-46a4-9d87-4773d39f55c2,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:03.402789 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:03.491649 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3811286'] for router_gateway, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:03.664990 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3812681', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2009'] for router, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:03.667334 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:03.797827 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3812965'] for router, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:03.798426 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 {{(pid=91821) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 27 09:40:03.812028 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] Notify callbacks [] for router, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:03.813871 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-bde08406-c15a-4abc-8d27-469ad30aed50 admin admin] 10.222.0.30 "DELETE /v2.0/routers/15d1c9f7-77f5-4a1a-9d2e-342fd8e16a05 HTTP/1.1" status: 204  len: 168 time: 1.2980862
May 27 09:40:03.816394 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58568) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:03.874521 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.db_base_plugin_v2 [None req-5e523076-5fb4-44f8-9fc8-9a586075225f admin admin] Deleting subnet c1677eac-45e9-4a22-9a63-044a5ded43ac {{(pid=91821) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:40:03.878059 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5e523076-5fb4-44f8-9fc8-9a586075225f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:03.934720 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5e523076-5fb4-44f8-9fc8-9a586075225f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-2232147'] for subnet, precommit_delete_associations {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:03.999656 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58572) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:04.104984 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5e523076-5fb4-44f8-9fc8-9a586075225f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:04.514096 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Deleting port de6a1dbd-4d37-4be9-b68e-dc2cb6c726e1 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:04.514859 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:04.588032 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device c7ac200f-e253-44d5-8112-cc54a37d8ba6 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:04.623597 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: c7ac200f-e253-44d5-8112-cc54a37d8ba6 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:04.624008 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device c7ac200f-e253-44d5-8112-cc54a37d8ba6 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:04.624366 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 63e2bf20-0d18-46a4-9d87-4773d39f55c2 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:04.634235 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5e523076-5fb4-44f8-9fc8-9a586075225f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2158057', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2399650'] for subnet, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:04.641849 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:04.692124 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e523076-5fb4-44f8-9fc8-9a586075225f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c1677eac-45e9-4a22-9a63-044a5ded43ac,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:04.694749 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-5e523076-5fb4-44f8-9fc8-9a586075225f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:04.696769 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:04.697100 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:04.699120 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 63e2bf20-0d18-46a4-9d87-4773d39f55c2 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:04.699510 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 63e2bf20-0d18-46a4-9d87-4773d39f55c2 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:04.707870 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-5e523076-5fb4-44f8-9fc8-9a586075225f admin admin] Notify callbacks [] for subnet, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:04.713130 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61383edd-5f74-4b49-adbd-eaa1d7f18307 None None] Network 8969d19b-2ae2-4dd6-9861-e28e315bba3f requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:40:04.771817 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-5e523076-5fb4-44f8-9fc8-9a586075225f admin admin] 10.222.0.30 "DELETE /v2.0/subnets/c1677eac-45e9-4a22-9a63-044a5ded43ac HTTP/1.1" status: 204  len: 168 time: 0.9542730
May 27 09:40:04.774313 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58576) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:04.835594 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Calling delete_port for de6a1dbd-4d37-4be9-b68e-dc2cb6c726e1 owned by network:floatingip {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:04.884411 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:04.963789 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Deleting port 0185e826-e937-479b-b6f5-990810f8a591 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:04.964133 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:04.977887 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:04.982343 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:04.989415 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] DHCP port deletion for 8969d19b-2ae2-4dd6-9861-e28e315bba3f request from dv-cinder-772623-6-iscsi {{(pid=91822) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 27 09:40:05.030822 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event deleted for resources: {'Port': ['ID=de6a1dbd-4d37-4be9-b68e-dc2cb6c726e1,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:05.033521 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:05.060154 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Deleting port 0185e826-e937-479b-b6f5-990810f8a591 {{(pid=91822) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:05.060541 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.139356 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.139731 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.l3_db [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Floating IP f2738fd6-55cf-4816-bd37-b20d5a49d7c7 disassociated (deleted). External IP: 172.27.1.204, port: 348676ad-03f8-47de-9659-1a3ee03e948d.
May 27 09:40:05.157369 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] For port 0185e826-e937-479b-b6f5-990810f8a591, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=0185e826-e937-479b-b6f5-990810f8a591,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:05.157859 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.193675 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] For port 0185e826-e937-479b-b6f5-990810f8a591, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=0185e826-e937-479b-b6f5-990810f8a591,segment=NetworkSegment(3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd),segment_id=3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:05.194023 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.280258 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Calling delete_port for 0185e826-e937-479b-b6f5-990810f8a591 owned by network:dhcp {{(pid=91822) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:05.322250 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Calling delete_port for 0185e826-e937-479b-b6f5-990810f8a591 owned by network:dhcp {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:05.328813 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116'] for port, after_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.334480 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-852e1364-110b-4900-af94-cba69b5f92b3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:05.373140 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.379195 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-01763f89-86f9-4ae6-9f69-93d40b7b3ad0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:05.380980 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Pushing event deleted for resources: {'Port': ['ID=0185e826-e937-479b-b6f5-990810f8a591,revision_number=None']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:05.383581 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] No DVR routers for this DVR port 0185e826-e937-479b-b6f5-990810f8a591 on host dv-cinder-772623-6-iscsi {{(pid=91822) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:40:05.394927 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.394927 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.394927 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.394927 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.395933 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.395933 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.396248 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.396585 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.396910 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.397234 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.397711 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.397983 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-772623-6-iscsi {{(pid=91822) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}}
May 27 09:40:05.401159 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:05.430712 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] No DVR routers for this DVR port 0185e826-e937-479b-b6f5-990810f8a591 on host dv-cinder-772623-6-iscsi {{(pid=91820) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:40:05.462892 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Pushing event deleted for resources: {'Port': ['ID=0185e826-e937-479b-b6f5-990810f8a591,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:05.465455 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:05.551793 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.564687 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2ee7078070>,) {'filters': {'network_id': ['8969d19b-2ae2-4dd6-9861-e28e315bba3f']}} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:05.581330 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee7078070>, '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd') {'for_net_delete': True} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:05.581544 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee7078070>, '3f9f29e8-2cd0-4c25-9b38-8a07cb84ebcd') {} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:05.593530 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3483835'] for segment, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.610558 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.617028 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Releasing vlan 398 on physical network physnet1 to pool {{(pid=91820) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:40:05.617975 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2421763'] for segment, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.626795 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   util.warn(
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   util.warn(
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   util.warn(
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched.  Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning.
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   util.warn(
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]: Traceback (most recent call last):
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     timer()
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     cb(*args, **kw)
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     return func(*args, **kwargs)
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     self._notify()
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     self.callback(batched_events)
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     event.method(event)
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     return f(self, *a, **k)
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._get(url).json()
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self.request(url, 'GET', **kwargs)
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:40:05.631933 dv-cinder-772623-6-iscsi neutron-server[91820]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:40:05.708078 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.711339 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:05.727276 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.737126 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Pushing event deleted for resources: {'Network': ['ID=8969d19b-2ae2-4dd6-9861-e28e315bba3f,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:05.741304 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:05.754212 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-29a10e8a-e480-4bf8-b7de-b5103686657e admin admin] 10.222.0.30 "DELETE /v2.0/networks/8969d19b-2ae2-4dd6-9861-e28e315bba3f HTTP/1.1" status: 204  len: 168 time: 0.9787214
May 27 09:40:05.757245 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58580) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:05.817950 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:40:05.828090 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cd9f1b8-9a59-483a-8f4d-d33e3ff7d6f7 None None] Sync routers for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:40:05.839230 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:05.839667 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cd9f1b8-9a59-483a-8f4d-d33e3ff7d6f7 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:05.840369 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-7cd9f1b8-9a59-483a-8f4d-d33e3ff7d6f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecb88130>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:39:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:05.900706 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "DELETE /v2.0/floatingips/f2738fd6-55cf-4816-bd37-b20d5a49d7c7 HTTP/1.1" status: 204  len: 168 time: 1.8976839
May 27 09:40:05.900706 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'tag': '348676ad-03f8-47de-9659-1a3ee03e948d'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:40:05.981222 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'tag': '348676ad-03f8-47de-9659-1a3ee03e948d', 'status': 'completed', 'code': 200}
May 27 09:40:06.028977 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-7cd9f1b8-9a59-483a-8f4d-d33e3ff7d6f7 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:06.091138 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1514c22a-9083-4e85-b3f4-2f51d9e25f0e req-54e1afe9-cc0f-49ad-b971-1a7dafab444b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:06.092269 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1514c22a-9083-4e85-b3f4-2f51d9e25f0e req-54e1afe9-cc0f-49ad-b971-1a7dafab444b service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 1099 time: 0.0849066
May 27 09:40:06.293305 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1514c22a-9083-4e85-b3f4-2f51d9e25f0e req-8a333ab7-8b86-438a-84d0-5fc7a8ab024e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:06.294776 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1514c22a-9083-4e85-b3f4-2f51d9e25f0e req-8a333ab7-8b86-438a-84d0-5fc7a8ab024e service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.1965642
May 27 09:40:06.378397 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1514c22a-9083-4e85-b3f4-2f51d9e25f0e req-b4715c3e-08d7-42d3-9498-938b35ea1afe service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=348676ad-03f8-47de-9659-1a3ee03e948d HTTP/1.1" status: 200  len: 217 time: 0.0714979
May 27 09:40:06.407728 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3816697'] for router_interface, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:06.408881 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-7cd9f1b8-9a59-483a-8f4d-d33e3ff7d6f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecb88130>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '7d9344fd-2118-4536-92dd-e198af5c71ff', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.30', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:d1:91:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:36:31Z', 'updated_at': '2021-05-27T09:36:34Z', 'revision_number': 1, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:06.415622 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cd9f1b8-9a59-483a-8f4d-d33e3ff7d6f7 None None] Checking router: 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:40:06.426661 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cd9f1b8-9a59-483a-8f4d-d33e3ff7d6f7 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:06.427286 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-7cd9f1b8-9a59-483a-8f4d-d33e3ff7d6f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecb88130>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:39:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:06.452370 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb596df6-e911-4644-aba6-28282dc9054e req-df585164-9720-4d4b-8ed5-b0f687261cd5 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:06.453188 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-fb596df6-e911-4644-aba6-28282dc9054e req-df585164-9720-4d4b-8ed5-b0f687261cd5 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Synchronizing usage tracker for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:40:06.466555 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1514c22a-9083-4e85-b3f4-2f51d9e25f0e req-63fb2490-f32d-455a-8534-057ba8374dce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:06.468111 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1514c22a-9083-4e85-b3f4-2f51d9e25f0e req-63fb2490-f32d-455a-8534-057ba8374dce service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0828514
May 27 09:40:06.520446 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-fb596df6-e911-4644-aba6-28282dc9054e req-df585164-9720-4d4b-8ed5-b0f687261cd5 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Unset dirty status for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:40:06.521708 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fb596df6-e911-4644-aba6-28282dc9054e req-df585164-9720-4d4b-8ed5-b0f687261cd5 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 946 time: 0.2721527
May 27 09:40:06.589762 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-fb596df6-e911-4644-aba6-28282dc9054e req-5abe74bb-aa0b-438f-bc0b-83ad6a542a68 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0577066
May 27 09:40:06.599917 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1514c22a-9083-4e85-b3f4-2f51d9e25f0e req-5a74704c-9157-45ad-a19e-564a2c02e87e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:06.601487 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1514c22a-9083-4e85-b3f4-2f51d9e25f0e req-5a74704c-9157-45ad-a19e-564a2c02e87e service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1253526
May 27 09:40:06.632709 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 0185e826-e937-479b-b6f5-990810f8a591 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:06.641649 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-7cd9f1b8-9a59-483a-8f4d-d33e3ff7d6f7 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:06.674385 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 0185e826-e937-479b-b6f5-990810f8a591 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:06.674933 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 0185e826-e937-479b-b6f5-990810f8a591 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:06.758282 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1514c22a-9083-4e85-b3f4-2f51d9e25f0e req-96b39c4a-db2c-4889-9728-34847ff44375 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1482725
May 27 09:40:06.896128 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-1514c22a-9083-4e85-b3f4-2f51d9e25f0e req-c9672707-c3a1-4644-8895-3f3f5e5c76f6 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.1302910
May 27 09:40:06.979665 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] Deleting port dd39c62e-c9b7-41c2-8a70-065090c50c6d {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:06.980013 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:07.040886 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-7cd9f1b8-9a59-483a-8f4d-d33e3ff7d6f7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecb88130>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '7d9344fd-2118-4536-92dd-e198af5c71ff', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.30', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:d1:91:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:36:31Z', 'updated_at': '2021-05-27T09:36:34Z', 'revision_number': 1, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:07.044718 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7cd9f1b8-9a59-483a-8f4d-d33e3ff7d6f7 None None] The sync data for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi is: [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_floatingips': [{'id': '7d9344fd-2118-4536-92dd-e198af5c71ff', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'floating_ip_address': '172.27.1.30', 'floating_network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'router_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'port_id': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 633, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'mac_address': 'fa:16:3e:d1:91:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-27T09:36:31Z', 'updated_at': '2021-05-27T09:36:34Z', 'revision_number': 1, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:40:07.105745 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] For port dd39c62e-c9b7-41c2-8a70-065090c50c6d, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=dd39c62e-c9b7-41c2-8a70-065090c50c6d,segment=NetworkSegment(4500d488-b8f9-4de4-8844-9685fc72351b),segment_id=4500d488-b8f9-4de4-8844-9685fc72351b)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:07.106101 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:07.231181 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] Calling delete_port for dd39c62e-c9b7-41c2-8a70-065090c50c6d owned by network:router_interface {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:07.263844 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-285526dd-428a-4c55-844f-970f5da4e75c None None] New status for floating IP f2738fd6-55cf-4816-bd37-b20d5a49d7c7: DOWN {{(pid=91822) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:40:07.487118 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:07.490597 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5592771f-b1f4-4143-9deb-28155195600e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:07.534567 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] Pushing event deleted for resources: {'Port': ['ID=dd39c62e-c9b7-41c2-8a70-065090c50c6d,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:07.537498 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:07.685054 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82928c89-7b7a-446e-bff3-687994731db2 req-cb717ff0-7617-460f-ae1f-610d7b4fe0c9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:07.686643 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-82928c89-7b7a-446e-bff3-687994731db2 req-cb717ff0-7617-460f-ae1f-610d7b4fe0c9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 946 time: 0.0987399
May 27 09:40:07.821934 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3683824', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3812169'] for router_interface, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:07.888231 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354076a1-a5b3-4704-8aa9-f92e6740513d req-e21192eb-a4cd-4321-afbb-aad20ef88686 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:07.889680 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-354076a1-a5b3-4704-8aa9-f92e6740513d req-e21192eb-a4cd-4321-afbb-aad20ef88686 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 946 time: 0.1611559
May 27 09:40:08.035414 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-82928c89-7b7a-446e-bff3-687994731db2 req-f8bd945e-5332-4c69-b47d-3f049ed6ce1c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Deleting port 348676ad-03f8-47de-9659-1a3ee03e948d {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:08.035658 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-82928c89-7b7a-446e-bff3-687994731db2 req-f8bd945e-5332-4c69-b47d-3f049ed6ce1c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:08.136928 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-354076a1-a5b3-4704-8aa9-f92e6740513d req-ca33a67e-ab67-473c-8d6f-bfcfb595d268 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.2406902
May 27 09:40:08.190781 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-82928c89-7b7a-446e-bff3-687994731db2 req-f8bd945e-5332-4c69-b47d-3f049ed6ce1c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] For port 348676ad-03f8-47de-9659-1a3ee03e948d, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=348676ad-03f8-47de-9659-1a3ee03e948d,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:08.191150 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-82928c89-7b7a-446e-bff3-687994731db2 req-f8bd945e-5332-4c69-b47d-3f049ed6ce1c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:08.201670 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] Router c53aa6c2-27af-4d14-85b8-2c147223e99f has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:40:08.318545 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-82928c89-7b7a-446e-bff3-687994731db2 req-f8bd945e-5332-4c69-b47d-3f049ed6ce1c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Calling delete_port for 348676ad-03f8-47de-9659-1a3ee03e948d owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:08.432375 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-82928c89-7b7a-446e-bff3-687994731db2 req-f8bd945e-5332-4c69-b47d-3f049ed6ce1c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:08.437984 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-a0d3ea37-de1c-42a0-8a0f-e11490c4f768 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:08.482738 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8bd945e-5332-4c69-b47d-3f049ed6ce1c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event deleted for resources: {'Port': ['ID=348676ad-03f8-47de-9659-1a3ee03e948d,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:08.486416 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-f8bd945e-5332-4c69-b47d-3f049ed6ce1c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:08.502449 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:40:08.513091 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85e5e339-ac6a-4848-baa5-ae1595f3711d None None] Sync routers for ids ['c53aa6c2-27af-4d14-85b8-2c147223e99f'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:40:08.522844 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-58844e9c-0ede-4d6e-858f-3b58ef4f7847 admin admin] 10.222.0.30 "PUT /v2.0/routers/c53aa6c2-27af-4d14-85b8-2c147223e99f/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7643526
May 27 09:40:08.525047 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58592) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:08.534621 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85e5e339-ac6a-4848-baa5-ae1595f3711d None None] Routers {'c53aa6c2-27af-4d14-85b8-2c147223e99f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:08.535264 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-85e5e339-ac6a-4848-baa5-ae1595f3711d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecbeebe0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:39:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['c53aa6c2-27af-4d14-85b8-2c147223e99f'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:08.554951 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-0093c4d7-c3e1-4798-9b24-ace7572a5e59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:08.565777 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-82928c89-7b7a-446e-bff3-687994731db2 req-f8bd945e-5332-4c69-b47d-3f049ed6ce1c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] No DVR routers for this DVR port 348676ad-03f8-47de-9659-1a3ee03e948d on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:40:08.568432 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-82928c89-7b7a-446e-bff3-687994731db2 req-f8bd945e-5332-4c69-b47d-3f049ed6ce1c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:08.571322 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'name': 'network-vif-deleted', 'tag': '348676ad-03f8-47de-9659-1a3ee03e948d'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:40:08.600124 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-82928c89-7b7a-446e-bff3-687994731db2 req-f8bd945e-5332-4c69-b47d-3f049ed6ce1c tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "DELETE /v2.0/ports/348676ad-03f8-47de-9659-1a3ee03e948d HTTP/1.1" status: 204  len: 173 time: 0.9075687
May 27 09:40:08.648310 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d864455-d938-45e0-9bf9-a69d420f3e89', 'name': 'network-vif-deleted', 'tag': '348676ad-03f8-47de-9659-1a3ee03e948d', 'status': 'completed', 'code': 200}
May 27 09:40:08.736946 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Notify callbacks [] for router, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:08.766931 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-85e5e339-ac6a-4848-baa5-ae1595f3711d None None] Set router c53aa6c2-27af-4d14-85b8-2c147223e99f gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:08.937058 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:09.020365 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Deleting port 2678ddcb-0d2c-48f7-be73-6d5978b932b8 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:09.020714 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:09.092642 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-85e5e339-ac6a-4848-baa5-ae1595f3711d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecbeebe0>, [{'id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'name': 'tempest-TestMinimumBasicScenario-685811052-router', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102'}], 'enable_snat': True}, 'gw_port_id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:43Z', 'updated_at': '2021-05-27T09:40:07Z', 'revision_number': 5, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'gw_port': {'id': '2678ddcb-0d2c-48f7-be73-6d5978b932b8', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ec:88', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 671, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.102', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:37:44Z', 'updated_at': '2021-05-27T09:37:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:09.096577 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85e5e339-ac6a-4848-baa5-ae1595f3711d None None] Checking router: c53aa6c2-27af-4d14-85b8-2c147223e99f for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:40:09.105100 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85e5e339-ac6a-4848-baa5-ae1595f3711d None None] Routers {'c53aa6c2-27af-4d14-85b8-2c147223e99f'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:09.105709 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-85e5e339-ac6a-4848-baa5-ae1595f3711d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecbeebe0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:39:42Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['c53aa6c2-27af-4d14-85b8-2c147223e99f'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:09.146410 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] For port 2678ddcb-0d2c-48f7-be73-6d5978b932b8, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=2678ddcb-0d2c-48f7-be73-6d5978b932b8,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:09.146772 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:09.285828 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Calling delete_port for 2678ddcb-0d2c-48f7-be73-6d5978b932b8 owned by network:router_gateway {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:09.293571 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-85e5e339-ac6a-4848-baa5-ae1595f3711d None None] Set router c53aa6c2-27af-4d14-85b8-2c147223e99f gateway port host: None {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:09.315242 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-cf4f6e2f-c0d3-4d4f-a5ba-bcd04cc94697 req-71493f77-12d8-4c02-a003-9206ebd1d2ab tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Synchronizing usage tracker for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:40:09.337964 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-cf4f6e2f-c0d3-4d4f-a5ba-bcd04cc94697 req-71493f77-12d8-4c02-a003-9206ebd1d2ab tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Unset dirty status for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:40:09.339648 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-cf4f6e2f-c0d3-4d4f-a5ba-bcd04cc94697 req-71493f77-12d8-4c02-a003-9206ebd1d2ab tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=0d864455-d938-45e0-9bf9-a69d420f3e89 HTTP/1.1" status: 200  len: 210 time: 0.0705028
May 27 09:40:09.405659 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-85e5e339-ac6a-4848-baa5-ae1595f3711d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecbeebe0>, [{'id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'name': 'tempest-TestMinimumBasicScenario-685811052-router', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:43Z', 'updated_at': '2021-05-27T09:40:08Z', 'revision_number': 6, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'gw_port_host': None}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:09.410705 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85e5e339-ac6a-4848-baa5-ae1595f3711d None None] The sync data for ids ['c53aa6c2-27af-4d14-85b8-2c147223e99f'] in dv-cinder-772623-6-iscsi is: [{'id': 'c53aa6c2-27af-4d14-85b8-2c147223e99f', 'name': 'tempest-TestMinimumBasicScenario-685811052-router', 'tenant_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:37:43Z', 'updated_at': '2021-05-27T09:40:08Z', 'revision_number': 6, 'project_id': '9b65b8fc5dc14dcc9f87da1d8841c39c', 'gw_port_host': None}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:40:09.457998 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:09.461618 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b83cc6fe-23ed-4a58-9563-d3b99509d3a7 tempest-TestMinimumBasicScenario-1074181890 tempest-TestMinimumBasicScenario-1074181890-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:09.505084 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Pushing event deleted for resources: {'Port': ['ID=2678ddcb-0d2c-48f7-be73-6d5978b932b8,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:09.508859 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:09.599510 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3811286'] for router_gateway, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:09.884161 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3812681', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2009'] for router, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:09.886409 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:09.909486 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3812965'] for router, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:09.909996 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c53aa6c2-27af-4d14-85b8-2c147223e99f {{(pid=91820) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 27 09:40:09.922809 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] Notify callbacks [] for router, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:09.923973 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-f6b6d7ea-5759-49fd-a70c-840ef3309122 admin admin] 10.222.0.30 "DELETE /v2.0/routers/c53aa6c2-27af-4d14-85b8-2c147223e99f HTTP/1.1" status: 204  len: 168 time: 1.3977535
May 27 09:40:09.927090 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58602) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:09.985777 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_v2 [None req-d9528c16-d9c8-4c2f-9b65-551f9e6093a0 admin admin] Deleting subnet fe415665-990d-4bb1-8e4f-012751497c62 {{(pid=91820) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:40:09.988959 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d9528c16-d9c8-4c2f-9b65-551f9e6093a0 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:10.040355 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d9528c16-d9c8-4c2f-9b65-551f9e6093a0 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3483778'] for subnet, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:10.119109 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d9528c16-d9c8-4c2f-9b65-551f9e6093a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:10.373610 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d9528c16-d9c8-4c2f-9b65-551f9e6093a0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2421409', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2490042'] for subnet, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:10.379293 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:10.417867 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9528c16-d9c8-4c2f-9b65-551f9e6093a0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fe415665-990d-4bb1-8e4f-012751497c62,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:10.423118 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-d9528c16-d9c8-4c2f-9b65-551f9e6093a0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:10.425628 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81038d95-3ff3-43e6-9803-30dba4a75ef0 None None] Network b0ffbf01-8157-4aea-b4fa-61eab4557646 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:40:10.426150 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-d9528c16-d9c8-4c2f-9b65-551f9e6093a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:10.435258 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-d9528c16-d9c8-4c2f-9b65-551f9e6093a0 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/fe415665-990d-4bb1-8e4f-012751497c62 HTTP/1.1" status: 204  len: 168 time: 0.5022097
May 27 09:40:10.435258 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58608) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:10.545729 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:10.637875 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 2678ddcb-0d2c-48f7-be73-6d5978b932b8 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:10.642837 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Deleting port dd3592fe-331e-41d5-b35f-add100bd7803 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:10.644148 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:10.676989 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 2678ddcb-0d2c-48f7-be73-6d5978b932b8 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:10.677776 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 2678ddcb-0d2c-48f7-be73-6d5978b932b8 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:10.678332 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device dd39c62e-c9b7-41c2-8a70-065090c50c6d no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:10.714931 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: dd39c62e-c9b7-41c2-8a70-065090c50c6d {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:10.715297 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device dd39c62e-c9b7-41c2-8a70-065090c50c6d not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:10.717975 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b270465d-89eb-4e15-9138-3118a0a3a18d None None] DHCP port deletion for b0ffbf01-8157-4aea-b4fa-61eab4557646 request from dv-cinder-772623-6-iscsi {{(pid=91822) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 27 09:40:10.768146 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] For port dd3592fe-331e-41d5-b35f-add100bd7803, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=dd3592fe-331e-41d5-b35f-add100bd7803,segment=NetworkSegment(4500d488-b8f9-4de4-8844-9685fc72351b),segment_id=4500d488-b8f9-4de4-8844-9685fc72351b)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:10.768514 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:10.788687 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-b270465d-89eb-4e15-9138-3118a0a3a18d None None] Deleting port dd3592fe-331e-41d5-b35f-add100bd7803 {{(pid=91822) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:10.789074 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-b270465d-89eb-4e15-9138-3118a0a3a18d None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:10.885936 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-b270465d-89eb-4e15-9138-3118a0a3a18d None None] For port dd3592fe-331e-41d5-b35f-add100bd7803, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=dd3592fe-331e-41d5-b35f-add100bd7803,segment=NetworkSegment(4500d488-b8f9-4de4-8844-9685fc72351b),segment_id=4500d488-b8f9-4de4-8844-9685fc72351b)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:10.886335 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-b270465d-89eb-4e15-9138-3118a0a3a18d None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:10.899954 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Calling delete_port for dd3592fe-331e-41d5-b35f-add100bd7803 owned by network:dhcp {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:10.951580 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 348676ad-03f8-47de-9659-1a3ee03e948d no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:10.952702 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:10.957278 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-37cc5942-15e8-4b82-ba5e-dc0c4049cb79 tempest-TestShelveInstance-387233134 tempest-TestShelveInstance-387233134-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:10.999206 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Pushing event deleted for resources: {'Port': ['ID=dd3592fe-331e-41d5-b35f-add100bd7803,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:11.003010 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:11.005216 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] No DVR routers for this DVR port dd3592fe-331e-41d5-b35f-add100bd7803 on host dv-cinder-772623-6-iscsi {{(pid=91820) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:40:11.073000 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-b270465d-89eb-4e15-9138-3118a0a3a18d None None] Calling delete_port for dd3592fe-331e-41d5-b35f-add100bd7803 owned by network:dhcp {{(pid=91822) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:11.081528 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 348676ad-03f8-47de-9659-1a3ee03e948d {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:11.081880 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 348676ad-03f8-47de-9659-1a3ee03e948d not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:11.122084 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-b270465d-89eb-4e15-9138-3118a0a3a18d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116'] for port, after_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.122692 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.125892 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:11.136167 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2ee716ce20>,) {'filters': {'network_id': ['b0ffbf01-8157-4aea-b4fa-61eab4557646']}} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:11.148945 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee716ce20>, '4500d488-b8f9-4de4-8844-9685fc72351b') {'for_net_delete': True} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:11.149245 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee716ce20>, '4500d488-b8f9-4de4-8844-9685fc72351b') {} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:11.160797 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3483835'] for segment, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.170406 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b270465d-89eb-4e15-9138-3118a0a3a18d None None] Pushing event deleted for resources: {'Port': ['ID=dd3592fe-331e-41d5-b35f-add100bd7803,revision_number=None']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:11.173818 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-b270465d-89eb-4e15-9138-3118a0a3a18d None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:11.176757 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b270465d-89eb-4e15-9138-3118a0a3a18d None None] No DVR routers for this DVR port dd3592fe-331e-41d5-b35f-add100bd7803 on host dv-cinder-772623-6-iscsi {{(pid=91822) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:40:11.177942 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.185900 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Releasing vlan 399 on physical network physnet1 to pool {{(pid=91820) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:40:11.186297 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2421763'] for segment, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]: Traceback (most recent call last):
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     timer()
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     cb(*args, **kw)
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     return func(*args, **kwargs)
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     self._notify()
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     self.callback(batched_events)
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     event.method(event)
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     return f(self, *a, **k)
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._get(url).json()
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self.request(url, 'GET', **kwargs)
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:40:11.200707 dv-cinder-772623-6-iscsi neutron-server[91820]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:40:11.280468 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.284774 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.287165 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:11.310072 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Pushing event deleted for resources: {'Network': ['ID=b0ffbf01-8157-4aea-b4fa-61eab4557646,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:11.312434 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:11.316759 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] 10.222.0.30 "DELETE /v2.0/networks/b0ffbf01-8157-4aea-b4fa-61eab4557646 HTTP/1.1" status: 204  len: 168 time: 0.8829691
May 27 09:40:11.470276 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.518675 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58618) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:11.567711 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-31b93102-f497-4657-a938-fdf7081ad40d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=892895f1788940b1bc09406239590e3f&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0468650
May 27 09:40:11.569910 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58622) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:11.630006 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0400a1dc-d625-4c44-913a-4e32413a2a60 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.655619 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0400a1dc-d625-4c44-913a-4e32413a2a60 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.713187 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0400a1dc-d625-4c44-913a-4e32413a2a60 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.716971 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-bb1b0bf5-ed3b-4daf-b57d-d08746953990 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:11.733202 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0400a1dc-d625-4c44-913a-4e32413a2a60 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b685e495-f031-4397-8903-69c0d36e6321,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:11.737335 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-0400a1dc-d625-4c44-913a-4e32413a2a60 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:11.740585 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-0400a1dc-d625-4c44-913a-4e32413a2a60 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:11.741702 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-0400a1dc-d625-4c44-913a-4e32413a2a60 admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b685e495-f031-4397-8903-69c0d36e6321 HTTP/1.1" status: 204  len: 168 time: 0.1708992
May 27 09:40:11.842326 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-70790f6d-0902-494d-a729-85d9a5485959 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:12.111564 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58636) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:12.159706 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-659842a6-f7a2-4501-9c65-19524b36b83d admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=9b65b8fc5dc14dcc9f87da1d8841c39c&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0468171
May 27 09:40:12.162270 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58640) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:12.230104 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-71a60792-8a98-4d59-a3ca-0eaa709c656a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:12.257425 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-71a60792-8a98-4d59-a3ca-0eaa709c656a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:12.311241 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-71a60792-8a98-4d59-a3ca-0eaa709c656a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:12.315489 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-669c221f-6406-4e15-9d34-f32af5da3a8d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:12.329166 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71a60792-8a98-4d59-a3ca-0eaa709c656a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64d00832-eb7a-4e85-afcf-eddfa92ac79a,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:12.332051 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-71a60792-8a98-4d59-a3ca-0eaa709c656a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:12.333753 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-71a60792-8a98-4d59-a3ca-0eaa709c656a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:12.334388 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-71a60792-8a98-4d59-a3ca-0eaa709c656a admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/64d00832-eb7a-4e85-afcf-eddfa92ac79a HTTP/1.1" status: 204  len: 168 time: 0.1712229
May 27 09:40:12.410460 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:12.591045 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device dd3592fe-331e-41d5-b35f-add100bd7803 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:12.628811 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: dd3592fe-331e-41d5-b35f-add100bd7803 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:12.629165 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device dd3592fe-331e-41d5-b35f-add100bd7803 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:12.929081 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58648) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:13.198914 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Deleting port ae2f80ab-9f6a-49e1-bb56-3c2898aedfea {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:13.199276 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:13.321880 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:13.322216 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:13.445684 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Calling delete_port for ae2f80ab-9f6a-49e1-bb56-3c2898aedfea owned by network:floatingip {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:13.570747 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:13.574328 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-dfee5024-cfb0-4b7f-a394-39f0f8d6fcc7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:13.709597 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event deleted for resources: {'Port': ['ID=ae2f80ab-9f6a-49e1-bb56-3c2898aedfea,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:13.712691 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:13.797814 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:13.798146 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.db.l3_db [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Floating IP 7d9344fd-2118-4536-92dd-e198af5c71ff disassociated (deleted). External IP: 172.27.1.30, port: 17f52729-5eea-473d-8d2b-fe7fd55dc845.
May 27 09:40:14.152789 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91821) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:40:14.328053 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91821) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:40:14.338339 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9faec03-fe78-43ad-8b07-87dd7a56f6c0 None None] Sync routers for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:40:14.349383 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9faec03-fe78-43ad-8b07-87dd7a56f6c0 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:14.349592 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:14.350020 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-f9faec03-fe78-43ad-8b07-87dd7a56f6c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecb77130>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:40:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:14.410540 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-7fbfa702-8b2b-4202-bfba-cd02f760bf95 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "DELETE /v2.0/floatingips/7d9344fd-2118-4536-92dd-e198af5c71ff HTTP/1.1" status: 204  len: 168 time: 1.4772964
May 27 09:40:14.410540 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'tag': '17f52729-5eea-473d-8d2b-fe7fd55dc845'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:40:14.454527 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'tag': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'status': 'completed', 'code': 200}
May 27 09:40:14.534486 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-f9faec03-fe78-43ad-8b07-87dd7a56f6c0 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:14.550030 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a942a9d8-1188-458d-8db5-2d0c082b11b7 req-974e681c-2c65-48b8-b84c-07996d8ea57a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:14.552002 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a942a9d8-1188-458d-8db5-2d0c082b11b7 req-974e681c-2c65-48b8-b84c-07996d8ea57a service neutron] 10.222.0.11 "GET /v2.0/ports?tenant_id=b8df97a650014930beb6e52081be8e90&device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 1099 time: 0.0764842
May 27 09:40:14.709380 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a942a9d8-1188-458d-8db5-2d0c082b11b7 req-1a54f8b9-2bf0-46ce-ac90-af0fc0e16274 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:14.711088 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a942a9d8-1188-458d-8db5-2d0c082b11b7 req-1a54f8b9-2bf0-46ce-ac90-af0fc0e16274 service neutron] 10.222.0.11 "GET /v2.0/networks?id=d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 200  len: 912 time: 0.1531124
May 27 09:40:14.822028 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a942a9d8-1188-458d-8db5-2d0c082b11b7 req-3224f2f6-8105-4a49-8397-184022bb78b3 service neutron] 10.222.0.11 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845 HTTP/1.1" status: 200  len: 217 time: 0.1034856
May 27 09:40:14.854460 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-f9faec03-fe78-43ad-8b07-87dd7a56f6c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecb77130>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:14.858305 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9faec03-fe78-43ad-8b07-87dd7a56f6c0 None None] Checking router: 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:40:14.867285 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9faec03-fe78-43ad-8b07-87dd7a56f6c0 None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:14.867916 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-f9faec03-fe78-43ad-8b07-87dd7a56f6c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecb77130>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:40:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:14.902262 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a942a9d8-1188-458d-8db5-2d0c082b11b7 req-16275fe0-afda-4b87-b60a-7acd037727a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:14.903792 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a942a9d8-1188-458d-8db5-2d0c082b11b7 req-16275fe0-afda-4b87-b60a-7acd037727a5 service neutron] 10.222.0.11 "GET /v2.0/subnets?id=3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 200  len: 850 time: 0.0693989
May 27 09:40:14.916749 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83f7c59c-91c1-47ee-9ea7-6bf07fbec331 req-d93ba813-2042-495f-b7d0-cf94c1d035a9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:14.917449 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-83f7c59c-91c1-47ee-9ea7-6bf07fbec331 req-d93ba813-2042-495f-b7d0-cf94c1d035a9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Synchronizing usage tracker for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:40:14.983098 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-83f7c59c-91c1-47ee-9ea7-6bf07fbec331 req-d93ba813-2042-495f-b7d0-cf94c1d035a9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Unset dirty status for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:40:14.984206 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-83f7c59c-91c1-47ee-9ea7-6bf07fbec331 req-d93ba813-2042-495f-b7d0-cf94c1d035a9 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 946 time: 0.2674446
May 27 09:40:15.027714 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:15.037537 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a942a9d8-1188-458d-8db5-2d0c082b11b7 req-2575f2a5-51cf-461c-8212-716d2347bde4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:15.039013 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a942a9d8-1188-458d-8db5-2d0c082b11b7 req-2575f2a5-51cf-461c-8212-716d2347bde4 service neutron] 10.222.0.11 "GET /v2.0/ports?network_id=d58a455f-cc80-4aa7-a530-ce993d4da5e4&device_owner=network%3Adhcp HTTP/1.1" status: 200  len: 1175 time: 0.1187587
May 27 09:40:15.043681 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-83f7c59c-91c1-47ee-9ea7-6bf07fbec331 req-fb7934b6-3242-40ff-9b48-b68168ecde63 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.0513077
May 27 09:40:15.055275 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-f9faec03-fe78-43ad-8b07-87dd7a56f6c0 None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:15.176340 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a942a9d8-1188-458d-8db5-2d0c082b11b7 req-22eaaa2c-e42d-4f24-8c7d-99847e463e42 service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=segments HTTP/1.1" status: 200  len: 212 time: 0.1296291
May 27 09:40:15.373721 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-f9faec03-fe78-43ad-8b07-87dd7a56f6c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecb77130>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:15.378141 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9faec03-fe78-43ad-8b07-87dd7a56f6c0 None None] The sync data for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi is: [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:32:55Z', 'revision_number': 4, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi', '_interfaces': [{'id': '5b3c7db8-4288-45a7-a18e-484e4c69dfbb', 'name': '', 'network_id': 'd58a455f-cc80-4aa7-a530-ce993d4da5e4', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'mac_address': 'fa:16:3e:c1:cc:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_interface', 'standard_attr_id': 519, 'fixed_ips': [{'subnet_id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:54Z', 'updated_at': '2021-05-27T09:33:03Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'subnets': [{'id': '3187e919-f2c3-422d-8e9c-3d158ef72b40', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:40:15.417664 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-a942a9d8-1188-458d-8db5-2d0c082b11b7 req-b10c2036-5f06-4524-a31d-cdb2ca85258f service neutron] 10.222.0.11 "GET /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200  len: 281 time: 0.2345405
May 27 09:40:15.573663 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ebba2e65-f6fe-440b-add9-bc644798e7e1 None None] New status for floating IP 7d9344fd-2118-4536-92dd-e198af5c71ff: DOWN {{(pid=91823) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}}
May 27 09:40:16.150246 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45341a50-bb7b-475a-a5b8-af8b0733d16e req-7df9dee8-f03e-4a68-9d00-f76280430b15 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:16.151724 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-45341a50-bb7b-475a-a5b8-af8b0733d16e req-7df9dee8-f03e-4a68-9d00-f76280430b15 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 946 time: 0.0860667
May 27 09:40:16.338055 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfac06a8-6f45-411c-abf7-c26cf272171a req-b7863e11-0a98-4380-a2b7-a5043a8a948e tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91821) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}}
May 27 09:40:16.339464 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dfac06a8-6f45-411c-abf7-c26cf272171a req-b7863e11-0a98-4380-a2b7-a5043a8a948e tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 946 time: 0.1868486
May 27 09:40:16.373289 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-45341a50-bb7b-475a-a5b8-af8b0733d16e req-e8479df9-92e3-49b2-946b-19a6ef767422 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Deleting port 17f52729-5eea-473d-8d2b-fe7fd55dc845 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:16.373629 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-45341a50-bb7b-475a-a5b8-af8b0733d16e req-e8479df9-92e3-49b2-946b-19a6ef767422 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:16.461497 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-dfac06a8-6f45-411c-abf7-c26cf272171a req-882e1825-ed1b-4cb9-b84e-451e21c273fd tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/security-groups?id=6de72829-ee9b-4468-8f5f-92fb65675d3b&fields=id&fields=name HTTP/1.1" status: 200  len: 313 time: 0.1157956
May 27 09:40:16.523422 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [req-45341a50-bb7b-475a-a5b8-af8b0733d16e req-e8479df9-92e3-49b2-946b-19a6ef767422 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] For port 17f52729-5eea-473d-8d2b-fe7fd55dc845, host hv-cinder-77262, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77262',level=0,port_id=17f52729-5eea-473d-8d2b-fe7fd55dc845,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:16.523778 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-45341a50-bb7b-475a-a5b8-af8b0733d16e req-e8479df9-92e3-49b2-946b-19a6ef767422 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:16.651192 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [req-45341a50-bb7b-475a-a5b8-af8b0733d16e req-e8479df9-92e3-49b2-946b-19a6ef767422 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Calling delete_port for 17f52729-5eea-473d-8d2b-fe7fd55dc845 owned by compute:nova {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:16.760937 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-45341a50-bb7b-475a-a5b8-af8b0733d16e req-e8479df9-92e3-49b2-946b-19a6ef767422 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:16.766355 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:16.812168 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8479df9-92e3-49b2-946b-19a6ef767422 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event deleted for resources: {'Port': ['ID=17f52729-5eea-473d-8d2b-fe7fd55dc845,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:16.815305 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-e8479df9-92e3-49b2-946b-19a6ef767422 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:16.889222 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [req-45341a50-bb7b-475a-a5b8-af8b0733d16e req-e8479df9-92e3-49b2-946b-19a6ef767422 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] No DVR routers for this DVR port 17f52729-5eea-473d-8d2b-fe7fd55dc845 on host hv-cinder-77262 {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:40:16.891675 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [req-45341a50-bb7b-475a-a5b8-af8b0733d16e req-e8479df9-92e3-49b2-946b-19a6ef767422 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for port, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:16.894435 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'name': 'network-vif-deleted', 'tag': '17f52729-5eea-473d-8d2b-fe7fd55dc845'}] {{(pid=91821) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}}
May 27 09:40:16.910268 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-45341a50-bb7b-475a-a5b8-af8b0733d16e req-e8479df9-92e3-49b2-946b-19a6ef767422 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.11 "DELETE /v2.0/ports/17f52729-5eea-473d-8d2b-fe7fd55dc845 HTTP/1.1" status: 204  len: 173 time: 0.7267175
May 27 09:40:16.941369 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '856e74c1-d17d-40d7-ab17-45319c89f85b', 'name': 'network-vif-deleted', 'tag': '17f52729-5eea-473d-8d2b-fe7fd55dc845', 'status': 'completed', 'code': 200}
May 27 09:40:17.626430 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-d3937fc4-e1ee-437d-9943-5b0ab1b63c52 req-9d01df98-749b-4f2d-89e6-2c110676176b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Synchronizing usage tracker for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) resync /opt/stack/neutron/neutron/quota/resource.py:241}}
May 27 09:40:17.643716 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.quota.resource [req-d3937fc4-e1ee-437d-9943-5b0ab1b63c52 req-9d01df98-749b-4f2d-89e6-2c110676176b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Unset dirty status for tenant:b8df97a650014930beb6e52081be8e90 on resource:port {{(pid=91821) _resync /opt/stack/neutron/neutron/quota/resource.py:233}}
May 27 09:40:17.644890 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [req-d3937fc4-e1ee-437d-9943-5b0ab1b63c52 req-9d01df98-749b-4f2d-89e6-2c110676176b tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "GET /v2.0/ports?device_id=856e74c1-d17d-40d7-ab17-45319c89f85b HTTP/1.1" status: 200  len: 210 time: 0.0614879
May 27 09:40:18.740936 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58666) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:18.964260 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Deleting port 05fdf8ce-5197-4ba6-8905-54270d7b3721 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:18.964611 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:19.186871 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:19.187197 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:19.309038 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Calling delete_port for 05fdf8ce-5197-4ba6-8905-54270d7b3721 owned by network:floatingip {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:19.424744 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:19.428601 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-cb4e4be1-f345-4295-bf65-91932352afd7 tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:19.472122 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event deleted for resources: {'Port': ['ID=05fdf8ce-5197-4ba6-8905-54270d7b3721,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:19.475522 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:19.566510 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for floatingip, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:19.583571 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-484119'] for floatingip, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:19.584721 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "DELETE /v2.0/floatingips/fc0f0f43-cc17-42cb-a998-b0842de1fdeb HTTP/1.1" status: 204  len: 168 time: 0.8428006
May 27 09:40:20.957709 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58680) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:21.025458 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5194fb91-8829-4e7d-856b-2dcb971aaa6a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:21.034123 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 17f52729-5eea-473d-8d2b-fe7fd55dc845 no longer exists at agent hyperv_hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:21.055760 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5194fb91-8829-4e7d-856b-2dcb971aaa6a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:21.067666 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] No Port match for: 17f52729-5eea-473d-8d2b-fe7fd55dc845 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:21.068026 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Device 17f52729-5eea-473d-8d2b-fe7fd55dc845 not bound to the agent host hv-cinder-77262 {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:21.119298 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5194fb91-8829-4e7d-856b-2dcb971aaa6a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:21.123028 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-b257f582-a0d4-4b6c-960a-dfb56ed78f1a tempest-AttachVolumeShelveTestJSON-1792635535 tempest-AttachVolumeShelveTestJSON-1792635535-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:21.137836 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5194fb91-8829-4e7d-856b-2dcb971aaa6a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=6de72829-ee9b-4468-8f5f-92fb65675d3b,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:21.140622 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5194fb91-8829-4e7d-856b-2dcb971aaa6a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:21.147804 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5194fb91-8829-4e7d-856b-2dcb971aaa6a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Notify callbacks [] for security_group, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:21.148928 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-5194fb91-8829-4e7d-856b-2dcb971aaa6a tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] 10.222.0.30 "DELETE /v2.0/security-groups/6de72829-ee9b-4468-8f5f-92fb65675d3b HTTP/1.1" status: 204  len: 168 time: 0.1902268
May 27 09:40:22.226721 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58688) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:23.018758 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3816697'] for router_interface, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:23.531051 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] Deleting port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:23.531803 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:23.656041 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] For port 5b3c7db8-4288-45a7-a18e-484e4c69dfbb, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=5b3c7db8-4288-45a7-a18e-484e4c69dfbb,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:23.656396 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:23.783072 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] Calling delete_port for 5b3c7db8-4288-45a7-a18e-484e4c69dfbb owned by network:router_interface {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:23.945581 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:23.950356 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-44600ecd-03d0-4d50-aaf2-1006e7c8ec67 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:24.030307 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] Pushing event deleted for resources: {'Port': ['ID=5b3c7db8-4288-45a7-a18e-484e4c69dfbb,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:24.037151 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:24.275586 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3683824', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3812169'] for router_interface, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:24.640305 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] Router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:40:24.927465 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:40:24.938357 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-862ba77b-a3e5-41f1-9847-156a90585a6d None None] Sync routers for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:40:24.941015 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-800e8915-8600-4381-9046-58f2ee661899 admin admin] 10.222.0.30 "PUT /v2.0/routers/3fbfa78b-08d5-463c-a8ae-78ec8a0d8662/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.7130177
May 27 09:40:24.943340 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58694) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:24.948713 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-862ba77b-a3e5-41f1-9847-156a90585a6d None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:24.949330 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-862ba77b-a3e5-41f1-9847-156a90585a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecf55ac0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:40:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:25.118768 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Notify callbacks [] for router, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:25.170597 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-862ba77b-a3e5-41f1-9847-156a90585a6d None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: dv-cinder-772623-6-iscsi {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:25.295142 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:25.372762 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Deleting port 8c399902-7a66-4c08-a29d-47eb71f37136 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:25.373110 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:25.454714 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-862ba77b-a3e5-41f1-9847-156a90585a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecf55ac0>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:40:23Z', 'revision_number': 5, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port': {'id': '8c399902-7a66-4c08-a29d-47eb71f37136', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:c4:f9:08', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'device_owner': 'network:router_gateway', 'standard_attr_id': 518, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:32:48Z', 'updated_at': '2021-05-27T09:32:56Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:25.458682 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-862ba77b-a3e5-41f1-9847-156a90585a6d None None] Checking router: 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 for host: dv-cinder-772623-6-iscsi {{(pid=91822) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:40:25.467337 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-862ba77b-a3e5-41f1-9847-156a90585a6d None None] Routers {'3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91822) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:25.467968 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-862ba77b-a3e5-41f1-9847-156a90585a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecf55ac0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:40:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'], 'active': True} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:25.500863 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] For port 8c399902-7a66-4c08-a29d-47eb71f37136, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=8c399902-7a66-4c08-a29d-47eb71f37136,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:25.501220 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:25.619901 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvr_db [None req-862ba77b-a3e5-41f1-9847-156a90585a6d None None] Set router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 gateway port host: None {{(pid=91822) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:25.628928 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Calling delete_port for 8c399902-7a66-4c08-a29d-47eb71f37136 owned by network:router_gateway {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:25.724116 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_hamode_db [None req-862ba77b-a3e5-41f1-9847-156a90585a6d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecf55ac0>, [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:40:25Z', 'revision_number': 6, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port_host': None}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91822) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:25.728296 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-862ba77b-a3e5-41f1-9847-156a90585a6d None None] The sync data for ids ['3fbfa78b-08d5-463c-a8ae-78ec8a0d8662'] in dv-cinder-772623-6-iscsi is: [{'id': '3fbfa78b-08d5-463c-a8ae-78ec8a0d8662', 'name': 'tempest-TestVolumeBootPattern-208023189-router', 'tenant_id': 'b8df97a650014930beb6e52081be8e90', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:32:46Z', 'updated_at': '2021-05-27T09:40:25Z', 'revision_number': 6, 'project_id': 'b8df97a650014930beb6e52081be8e90', 'gw_port_host': None}] {{(pid=91822) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:40:25.770112 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:25.774744 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4f221b1c-5c39-4452-9ba8-07eba4904272 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:25.846743 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Pushing event deleted for resources: {'Port': ['ID=8c399902-7a66-4c08-a29d-47eb71f37136,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:25.849049 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:25.913721 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3811286'] for router_gateway, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.094013 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3812681', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2009'] for router, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.096921 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.123464 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3812965'] for router, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.124318 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 {{(pid=91820) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 27 09:40:26.140369 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] Notify callbacks [] for router, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.141519 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-0bbac6ba-065d-4ffb-b353-3cabd4e58ca6 admin admin] 10.222.0.30 "DELETE /v2.0/routers/3fbfa78b-08d5-463c-a8ae-78ec8a0d8662 HTTP/1.1" status: 204  len: 168 time: 1.1972558
May 27 09:40:26.144932 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58698) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:26.206970 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_v2 [None req-4e807234-b624-45f8-9f12-7d2cb5d4fb92 admin admin] Deleting subnet 3187e919-f2c3-422d-8e9c-3d158ef72b40 {{(pid=91820) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:40:26.210012 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4e807234-b624-45f8-9f12-7d2cb5d4fb92 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.258395 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4e807234-b624-45f8-9f12-7d2cb5d4fb92 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3483778'] for subnet, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.333887 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4e807234-b624-45f8-9f12-7d2cb5d4fb92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.516229 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.602190 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 8c399902-7a66-4c08-a29d-47eb71f37136 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:26.637612 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 8c399902-7a66-4c08-a29d-47eb71f37136 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:26.637985 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 8c399902-7a66-4c08-a29d-47eb71f37136 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:26.638410 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 5b3c7db8-4288-45a7-a18e-484e4c69dfbb no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:26.671584 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 5b3c7db8-4288-45a7-a18e-484e4c69dfbb {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:26.671939 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 5b3c7db8-4288-45a7-a18e-484e4c69dfbb not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:26.706141 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4e807234-b624-45f8-9f12-7d2cb5d4fb92 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2421409', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2490042'] for subnet, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.710277 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5f3120ce-44c4-4266-9776-c0910cb368c2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:26.750761 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e807234-b624-45f8-9f12-7d2cb5d4fb92 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3187e919-f2c3-422d-8e9c-3d158ef72b40,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:26.753328 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-4e807234-b624-45f8-9f12-7d2cb5d4fb92 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.757414 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4e807234-b624-45f8-9f12-7d2cb5d4fb92 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:26.758350 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f12c682-4a30-472f-8623-0a2bc6e25af0 None None] Network d58a455f-cc80-4aa7-a530-ce993d4da5e4 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:40:26.760192 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-4e807234-b624-45f8-9f12-7d2cb5d4fb92 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/3187e919-f2c3-422d-8e9c-3d158ef72b40 HTTP/1.1" status: 204  len: 168 time: 0.6143320
May 27 09:40:26.762669 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58702) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:26.869210 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:26.941601 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Deleting port 776051f2-913a-4ae9-986b-d2455e629b25 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:26.941940 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.010899 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d9d92a6-fee3-45c6-8479-1f2f6e2e5c20 None None] DHCP port deletion for d58a455f-cc80-4aa7-a530-ce993d4da5e4 request from dv-cinder-772623-6-iscsi {{(pid=91822) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 27 09:40:27.044004 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] For port 776051f2-913a-4ae9-986b-d2455e629b25, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=776051f2-913a-4ae9-986b-d2455e629b25,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:27.044279 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.075138 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-1d9d92a6-fee3-45c6-8479-1f2f6e2e5c20 None None] Deleting port 776051f2-913a-4ae9-986b-d2455e629b25 {{(pid=91822) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:27.075548 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1d9d92a6-fee3-45c6-8479-1f2f6e2e5c20 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.166203 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Calling delete_port for 776051f2-913a-4ae9-986b-d2455e629b25 owned by network:dhcp {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:27.173450 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-1d9d92a6-fee3-45c6-8479-1f2f6e2e5c20 None None] For port 776051f2-913a-4ae9-986b-d2455e629b25, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=776051f2-913a-4ae9-986b-d2455e629b25,segment=NetworkSegment(c16c67eb-22c2-4695-a761-73d0611cf64a),segment_id=c16c67eb-22c2-4695-a761-73d0611cf64a)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:27.174444 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1d9d92a6-fee3-45c6-8479-1f2f6e2e5c20 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.212625 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.217274 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-6c9253c5-9823-4f12-b94a-52abd7cb6a49 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:27.263424 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Pushing event deleted for resources: {'Port': ['ID=776051f2-913a-4ae9-986b-d2455e629b25,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:27.266833 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:27.270135 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] No DVR routers for this DVR port 776051f2-913a-4ae9-986b-d2455e629b25 on host dv-cinder-772623-6-iscsi {{(pid=91820) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:40:27.295589 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-1d9d92a6-fee3-45c6-8479-1f2f6e2e5c20 None None] Calling delete_port for 776051f2-913a-4ae9-986b-d2455e629b25 owned by network:dhcp {{(pid=91822) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:27.337624 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1d9d92a6-fee3-45c6-8479-1f2f6e2e5c20 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116'] for port, after_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.341189 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-2acb4cd4-1f1c-4ec9-9123-bd05301d184a None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:27.389434 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.404234 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2ee74c1430>,) {'filters': {'network_id': ['d58a455f-cc80-4aa7-a530-ce993d4da5e4']}} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:27.417709 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee74c1430>, 'c16c67eb-22c2-4695-a761-73d0611cf64a') {'for_net_delete': True} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:27.418008 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.services.segments.db [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2ee74c1430>, 'c16c67eb-22c2-4695-a761-73d0611cf64a') {} {{(pid=91820) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:27.427858 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d9d92a6-fee3-45c6-8479-1f2f6e2e5c20 None None] Pushing event deleted for resources: {'Port': ['ID=776051f2-913a-4ae9-986b-d2455e629b25,revision_number=None']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:27.430826 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-1d9d92a6-fee3-45c6-8479-1f2f6e2e5c20 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:27.431309 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3483835'] for segment, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.431653 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1d9d92a6-fee3-45c6-8479-1f2f6e2e5c20 None None] No DVR routers for this DVR port 776051f2-913a-4ae9-986b-d2455e629b25 on host dv-cinder-772623-6-iscsi {{(pid=91822) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:40:27.450516 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.457127 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Releasing vlan 393 on physical network physnet1 to pool {{(pid=91820) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:40:27.457514 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2421763'] for segment, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]: Traceback (most recent call last):
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     timer()
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     cb(*args, **kw)
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     return func(*args, **kwargs)
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     self._notify()
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     self.callback(batched_events)
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     event.method(event)
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     return f(self, *a, **k)
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._get(url).json()
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     return self.request(url, 'GET', **kwargs)
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:40:27.470645 dv-cinder-772623-6-iscsi neutron-server[91820]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:40:27.550768 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.554407 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-1d6e824c-ad4e-433b-a1ac-9b11ef97b4cd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:27.568306 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:27.578382 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Pushing event deleted for resources: {'Network': ['ID=d58a455f-cc80-4aa7-a530-ce993d4da5e4,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:27.581972 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:27.592251 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-c359a7e5-aad5-4a15-bc83-c660b708f1a8 admin admin] 10.222.0.30 "DELETE /v2.0/networks/d58a455f-cc80-4aa7-a530-ce993d4da5e4 HTTP/1.1" status: 204  len: 168 time: 0.8286552
May 27 09:40:27.595346 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58706) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:28.246281 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-3816697'] for router_interface, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:28.594519 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 776051f2-913a-4ae9-986b-d2455e629b25 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:28.630125 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 776051f2-913a-4ae9-986b-d2455e629b25 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:28.630477 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 776051f2-913a-4ae9-986b-d2455e629b25 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:28.662866 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] Deleting port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:28.663209 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:28.788373 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] For port bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62,segment=NetworkSegment(0830e60f-fb48-48f7-a89b-adcde111560d),segment_id=0830e60f-fb48-48f7-a89b-adcde111560d)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:28.788727 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:28.914362 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] Calling delete_port for bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 owned by network:router_interface {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:29.069917 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:29.073470 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-a5e0d6f8-a689-416c-99e4-1158268fed44 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:29.119953 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] Pushing event deleted for resources: {'Port': ['ID=bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:29.122774 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:29.390962 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-3683824', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-3812169'] for router_interface, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:29.865530 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] Router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc has already been hosted by L3 agent 8da8c572-09e0-482d-b668-030ddec9c395 {{(pid=91820) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}}
May 27 09:40:30.053667 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] Notify agent at l3_agent.dv-cinder-772623-6-iscsi the message routers_updated {{(pid=91820) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}}
May 27 09:40:30.061885 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be0d5325-bb96-413b-b607-593f165d289d None None] Sync routers for ids ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'] in dv-cinder-772623-6-iscsi {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}}
May 27 09:40:30.070027 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-073e7080-168b-4afa-9bd5-5674e6ae48b8 admin admin] 10.222.0.30 "PUT /v2.0/routers/5b0cc38b-30b3-45d8-9de5-a137ad6395cc/remove_router_interface HTTP/1.1" status: 200  len: 503 time: 2.4730055
May 27 09:40:30.072455 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be0d5325-bb96-413b-b607-593f165d289d None None] Routers {'5b0cc38b-30b3-45d8-9de5-a137ad6395cc'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:30.072626 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58710) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:30.073420 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-be0d5325-bb96-413b-b607-593f165d289d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecdb1af0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:40:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:30.176392 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:40:30.255160 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Notify callbacks [] for router, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:30.276547 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-be0d5325-bb96-413b-b607-593f165d289d None None] Set router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc gateway port host: dv-cinder-772623-6-iscsi {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:30.438709 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:30.510271 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Deleting port 5d050986-7f7e-4195-a5af-217efc53ed28 {{(pid=91820) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:30.510608 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:30.562699 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-be0d5325-bb96-413b-b607-593f165d289d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecdb1af0>, [{'id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'name': 'tempest-TestVolumeBootPattern-667651670-router', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'external_fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159'}], 'enable_snat': True}, 'gw_port_id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:33:01Z', 'updated_at': '2021-05-27T09:40:29Z', 'revision_number': 5, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'gw_port': {'id': '5d050986-7f7e-4195-a5af-217efc53ed28', 'name': '', 'network_id': '8ebf3ddf-9506-4320-bd22-b3ade14a6cae', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:7f:20', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'device_owner': 'network:router_gateway', 'standard_attr_id': 536, 'fixed_ips': [{'subnet_id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'ip_address': '172.27.1.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-772623-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-27T09:33:02Z', 'updated_at': '2021-05-27T09:33:08Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '4506464c-a125-4c0f-8a03-19e4816fe82e', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-772623-6-iscsi'}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:30.567441 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be0d5325-bb96-413b-b607-593f165d289d None None] Checking router: 5b0cc38b-30b3-45d8-9de5-a137ad6395cc for host: dv-cinder-772623-6-iscsi {{(pid=91823) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}}
May 27 09:40:30.575950 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be0d5325-bb96-413b-b607-593f165d289d None None] Routers {'5b0cc38b-30b3-45d8-9de5-a137ad6395cc'} bound to L3 agent in host dv-cinder-772623-6-iscsi {{(pid=91823) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}}
May 27 09:40:30.576571 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-be0d5325-bb96-413b-b607-593f165d289d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (<neutron_lib.context.Context object at 0x7f2eecdb1af0>, 'dv-cinder-772623-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-27T09:19:12Z,description=<?>,heartbeat_timestamp=2021-05-27T09:40:12Z,host='dv-cinder-772623-6-iscsi',id=8da8c572-09e0-482d-b668-030ddec9c395,load=0,resource_versions=<?>,resources_synced=<?>,started_at=2021-05-27T09:19:12Z,topic='l3_agent')) {'router_ids': ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'], 'active': True} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:30.634513 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.db [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] For port 5d050986-7f7e-4195-a5af-217efc53ed28, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=5d050986-7f7e-4195-a5af-217efc53ed28,segment=NetworkSegment(c9d11f8e-7743-4d8a-b53e-c5e082b29e82),segment_id=c9d11f8e-7743-4d8a-b53e-c5e082b29e82)] {{(pid=91820) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:30.634846 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:30.726781 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_dvr_db [None req-be0d5325-bb96-413b-b607-593f165d289d None None] Set router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc gateway port host: None {{(pid=91823) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}}
May 27 09:40:30.762756 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.plugins.ml2.plugin [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Calling delete_port for 5d050986-7f7e-4195-a5af-217efc53ed28 owned by network:router_gateway {{(pid=91820) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:30.829713 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.l3_hamode_db [None req-be0d5325-bb96-413b-b607-593f165d289d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (<neutron_lib.context.Context object at 0x7f2eecdb1af0>, [{'id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'name': 'tempest-TestVolumeBootPattern-667651670-router', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:33:01Z', 'updated_at': '2021-05-27T09:40:30Z', 'revision_number': 6, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'gw_port_host': None}], 'dv-cinder-772623-6-iscsi', False) {} {{(pid=91823) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:30.834409 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-be0d5325-bb96-413b-b607-593f165d289d None None] The sync data for ids ['5b0cc38b-30b3-45d8-9de5-a137ad6395cc'] in dv-cinder-772623-6-iscsi is: [{'id': '5b0cc38b-30b3-45d8-9de5-a137ad6395cc', 'name': 'tempest-TestVolumeBootPattern-667651670-router', 'tenant_id': '84f0499276a14bb58311b0634f9b1dde', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-27T09:33:01Z', 'updated_at': '2021-05-27T09:40:30Z', 'revision_number': 6, 'project_id': '84f0499276a14bb58311b0634f9b1dde', 'gw_port_host': None}] {{(pid=91823) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}}
May 27 09:40:30.899486 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2421840'] for port, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:30.902948 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-4d1835c3-2b17-4579-b016-45f2bee09602 tempest-TestVolumeBootPattern-1712772318 tempest-TestVolumeBootPattern-1712772318-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:31.059984 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Pushing event deleted for resources: {'Port': ['ID=5d050986-7f7e-4195-a5af-217efc53ed28,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:31.062362 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:31.150353 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-3811286'] for router_gateway, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:31.325348 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-3812681', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2009'] for router, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:31.327518 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:31.351718 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-3812965'] for router, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:31.352368 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5b0cc38b-30b3-45d8-9de5-a137ad6395cc {{(pid=91820) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}}
May 27 09:40:31.365062 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] Notify callbacks [] for router, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:31.366183 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-5224e146-4383-4164-accd-2c7a547ce137 admin admin] 10.222.0.30 "DELETE /v2.0/routers/5b0cc38b-30b3-45d8-9de5-a137ad6395cc HTTP/1.1" status: 204  len: 168 time: 1.2927125
May 27 09:40:31.368713 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [-] (91820) accepted ('10.222.0.30', 58714) {{(pid=91820) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:31.430306 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.db.db_base_plugin_v2 [None req-3313a808-4c40-491a-acd4-ccfb3f10e3f9 admin admin] Deleting subnet e4136c87-14f9-437e-ad77-15645c706d7f {{(pid=91820) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}}
May 27 09:40:31.433328 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3313a808-4c40-491a-acd4-ccfb3f10e3f9 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:31.484799 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3313a808-4c40-491a-acd4-ccfb3f10e3f9 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3483778'] for subnet, precommit_delete_associations {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:31.567468 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3313a808-4c40-491a-acd4-ccfb3f10e3f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-861176'] for subnet, precommit_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:31.822743 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3313a808-4c40-491a-acd4-ccfb3f10e3f9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-864047', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63380', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-2421409', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-2490042'] for subnet, after_delete {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:31.826766 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:31.866012 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3313a808-4c40-491a-acd4-ccfb3f10e3f9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e4136c87-14f9-437e-ad77-15645c706d7f,revision_number=None']} {{(pid=91820) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:31.869060 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG oslo_concurrency.lockutils [None req-3313a808-4c40-491a-acd4-ccfb3f10e3f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:31.870788 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron_lib.callbacks.manager [None req-3313a808-4c40-491a-acd4-ccfb3f10e3f9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for subnet, before_response {{(pid=91820) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:31.875159 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d0039c20-3f63-4250-b038-851174570699 None None] Network 59236645-74b3-4245-96bc-3faea65c95e6 requested from dv-cinder-772623-6-iscsi {{(pid=91822) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}}
May 27 09:40:31.878763 dv-cinder-772623-6-iscsi neutron-server[91820]: INFO neutron.wsgi [None req-3313a808-4c40-491a-acd4-ccfb3f10e3f9 admin admin] 10.222.0.30 "DELETE /v2.0/subnets/e4136c87-14f9-437e-ad77-15645c706d7f HTTP/1.1" status: 204  len: 168 time: 0.5089004
May 27 09:40:31.879300 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58718) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:31.989415 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-532076'] for network, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.065814 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Deleting port 500f45f3-3886-4110-8b1f-acee6fc33332 {{(pid=91821) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:32.066161 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.126409 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-199a5b3f-ebce-47eb-ad0c-e8ea67f5a0cf None None] DHCP port deletion for 59236645-74b3-4245-96bc-3faea65c95e6 request from dv-cinder-772623-6-iscsi {{(pid=91822) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}}
May 27 09:40:32.167189 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.db [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] For port 500f45f3-3886-4110-8b1f-acee6fc33332, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=500f45f3-3886-4110-8b1f-acee6fc33332,segment=NetworkSegment(0830e60f-fb48-48f7-a89b-adcde111560d),segment_id=0830e60f-fb48-48f7-a89b-adcde111560d)] {{(pid=91821) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:32.167589 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.193965 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-199a5b3f-ebce-47eb-ad0c-e8ea67f5a0cf None None] Deleting port 500f45f3-3886-4110-8b1f-acee6fc33332 {{(pid=91822) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}}
May 27 09:40:32.194356 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-199a5b3f-ebce-47eb-ad0c-e8ea67f5a0cf None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8739971489356'] for port, before_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.295714 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.plugin [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Calling delete_port for 500f45f3-3886-4110-8b1f-acee6fc33332 owned by network:dhcp {{(pid=91821) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:32.296229 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.db [None req-199a5b3f-ebce-47eb-ad0c-e8ea67f5a0cf None None] For port 500f45f3-3886-4110-8b1f-acee6fc33332, host dv-cinder-772623-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-772623-6-iscsi',level=0,port_id=500f45f3-3886-4110-8b1f-acee6fc33332,segment=NetworkSegment(0830e60f-fb48-48f7-a89b-adcde111560d),segment_id=0830e60f-fb48-48f7-a89b-adcde111560d)] {{(pid=91822) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}}
May 27 09:40:32.296631 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-199a5b3f-ebce-47eb-ad0c-e8ea67f5a0cf None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-3810314'] for port, precommit_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.342820 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-2157336'] for port, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.348160 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-91c72e96-25fd-4c98-ba58-1ab42bc34ac8 tempest-AttachVolumeTestJSON-596001956 tempest-AttachVolumeTestJSON-596001956-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:32.391745 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Pushing event deleted for resources: {'Port': ['ID=500f45f3-3886-4110-8b1f-acee6fc33332,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:32.394987 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:32.395788 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] No DVR routers for this DVR port 500f45f3-3886-4110-8b1f-acee6fc33332 on host dv-cinder-772623-6-iscsi {{(pid=91821) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:40:32.422747 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-199a5b3f-ebce-47eb-ad0c-e8ea67f5a0cf None None] Calling delete_port for 500f45f3-3886-4110-8b1f-acee6fc33332 owned by network:dhcp {{(pid=91822) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}}
May 27 09:40:32.466304 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-199a5b3f-ebce-47eb-ad0c-e8ea67f5a0cf None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-770545', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-63343', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-3683810', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8739971492262', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8739971057116'] for port, after_delete {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.470059 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-c6f4f311-eb5e-4750-b610-747273f1715c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:32.516265 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-199a5b3f-ebce-47eb-ad0c-e8ea67f5a0cf None None] Pushing event deleted for resources: {'Port': ['ID=500f45f3-3886-4110-8b1f-acee6fc33332,revision_number=None']} {{(pid=91822) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:32.519327 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG oslo_concurrency.lockutils [None req-199a5b3f-ebce-47eb-ad0c-e8ea67f5a0cf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:32.521969 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.db.l3_dvrscheduler_db [None req-199a5b3f-ebce-47eb-ad0c-e8ea67f5a0cf None None] No DVR routers for this DVR port 500f45f3-3886-4110-8b1f-acee6fc33332 on host dv-cinder-772623-6-iscsi {{(pid=91822) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}}
May 27 09:40:32.601294 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 5d050986-7f7e-4195-a5af-217efc53ed28 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:32.607673 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-857701', 'neutron.services.segments.db._delete_segments_for_network-8739971585253'] for network, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.624883 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x7f2eec7b5af0>,) {'filters': {'network_id': ['59236645-74b3-4245-96bc-3faea65c95e6']}} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:32.634280 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 5d050986-7f7e-4195-a5af-217efc53ed28 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:32.634635 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 5d050986-7f7e-4195-a5af-217efc53ed28 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:32.635058 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:32.637837 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec7b5af0>, '0830e60f-fb48-48f7-a89b-adcde111560d') {'for_net_delete': True} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:32.638143 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.services.segments.db [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (<neutron_lib.context.Context object at 0x7f2eec7b5af0>, '0830e60f-fb48-48f7-a89b-adcde111560d') {} {{(pid=91821) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}}
May 27 09:40:32.650534 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8739971592358', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-2232170'] for segment, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.667903 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:32.668256 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device bf7f2ebb-5ee7-4fd8-9f03-d2a792951d62 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:32.668875 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 500f45f3-3886-4110-8b1f-acee6fc33332 no longer exists at agent ovs-agent-dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}}
May 27 09:40:32.670527 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733'] for segment, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.677630 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Releasing vlan 375 on physical network physnet1 to pool {{(pid=91821) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}}
May 27 09:40:32.678041 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-866733', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-2157387'] for segment, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]: Traceback (most recent call last):
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     timer()
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     cb(*args, **kw)
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     return func(*args, **kwargs)
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     self._notify()
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     self.callback(batched_events)
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     event.method(event)
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_id = self._get_aggregate_id(event.segment_id)
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     aggregate_uuid = self.p_client.list_aggregates(
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     return f(self, *a, **k)
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._get(url).json()
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self._client.get(url, endpoint_filter=self._ks_filter,
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     return self.request(url, 'GET', **kwargs)
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     base_url = self.get_endpoint(auth, allow=allow,
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     auth = self._auth_required(auth, 'determine endpoint URL')
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:   File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]:     raise exceptions.MissingAuthPlugin(msg_fmt % msg)
May 27 09:40:32.691321 dv-cinder-772623-6-iscsi neutron-server[91821]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL
May 27 09:40:32.704053 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.plugin [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] No Port match for: 500f45f3-3886-4110-8b1f-acee6fc33332 {{(pid=91822) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}}
May 27 09:40:32.704404 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron.plugins.ml2.rpc [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Device 500f45f3-3886-4110-8b1f-acee6fc33332 not bound to the agent host dv-cinder-772623-6-iscsi {{(pid=91822) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}}
May 27 09:40:32.765604 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-857722', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-3869508', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-3683819', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-3811321'] for network, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.770333 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:32.783651 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-3683788'] for network, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:32.794043 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Pushing event deleted for resources: {'Network': ['ID=59236645-74b3-4245-96bc-3faea65c95e6,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:32.798232 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:32.802751 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-92bcac80-da41-4755-9cee-a6631714711e admin admin] 10.222.0.30 "DELETE /v2.0/networks/59236645-74b3-4245-96bc-3faea65c95e6 HTTP/1.1" status: 204  len: 168 time: 0.9224453
May 27 09:40:32.917658 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58726) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:32.970442 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-fec2c15c-3f7c-44b7-b915-5d7c84f81625 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=b8df97a650014930beb6e52081be8e90&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0515680
May 27 09:40:32.973487 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58730) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:33.029171 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8889ff69-d042-4076-8094-9b55a4caf17b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:33.054323 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8889ff69-d042-4076-8094-9b55a4caf17b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:33.106735 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8889ff69-d042-4076-8094-9b55a4caf17b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:33.112601 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-07f5faae-5812-4661-b25e-28432b34f352 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:33.125817 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8889ff69-d042-4076-8094-9b55a4caf17b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9ba1dd74-b031-4983-b71f-2b448c236713,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:33.130601 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-8889ff69-d042-4076-8094-9b55a4caf17b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:33.133828 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-8889ff69-d042-4076-8094-9b55a4caf17b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:33.134953 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-8889ff69-d042-4076-8094-9b55a4caf17b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/9ba1dd74-b031-4983-b71f-2b448c236713 HTTP/1.1" status: 204  len: 168 time: 0.1605916
May 27 09:40:33.477133 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58742) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:33.525282 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-df7c165f-aee8-4ad1-8700-d74f939a6c01 admin admin] 10.222.0.30 "GET /v2.0/security-groups?tenant_id=84f0499276a14bb58311b0634f9b1dde&name=default HTTP/1.1" status: 200  len: 2979 time: 0.0468252
May 27 09:40:33.527560 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.wsgi [-] (91821) accepted ('10.222.0.30', 58746) {{(pid=91821) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}}
May 27 09:40:33.587346 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-56b61670-89e0-4bd4-8892-f6a656e59c0b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:33.613327 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-56b61670-89e0-4bd4-8892-f6a656e59c0b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:33.663555 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-56b61670-89e0-4bd4-8892-f6a656e59c0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-3869542'] for security_group, after_delete {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:33.667101 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-674d7faf-44ea-4184-9613-80fe8ae57530 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}}
May 27 09:40:33.678823 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56b61670-89e0-4bd4-8892-f6a656e59c0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b14b983e-0cd2-48a1-ae8a-328d9ce4f2c0,revision_number=None']} {{(pid=91821) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}}
May 27 09:40:33.682171 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG oslo_concurrency.lockutils [None req-56b61670-89e0-4bd4-8892-f6a656e59c0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}}
May 27 09:40:33.685757 dv-cinder-772623-6-iscsi neutron-server[91821]: DEBUG neutron_lib.callbacks.manager [None req-56b61670-89e0-4bd4-8892-f6a656e59c0b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91821) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:33.689172 dv-cinder-772623-6-iscsi neutron-server[91821]: INFO neutron.wsgi [None req-56b61670-89e0-4bd4-8892-f6a656e59c0b admin admin] 10.222.0.30 "DELETE /v2.0/security-groups/b14b983e-0cd2-48a1-ae8a-328d9ce4f2c0 HTTP/1.1" status: 204  len: 168 time: 0.1584270
May 27 09:40:38.542772 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-92dbcc97-00bd-4677-b5d4-e7b691e938fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:41.476078 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:41.834388 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-f53ef92c-95e2-4745-935c-7402290f19f1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:42.413276 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:44.960676 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:40:56.516606 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:07.166321 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:41:08.545369 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-34fc3629-982f-4ff0-974f-fb5a877c8064 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:11.479257 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:11.835463 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-70b5facc-2481-4b8e-ab01-251cd7c1bc32 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:12.416443 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:14.965693 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:26.529679 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:38.547919 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-9d1fc2a7-3893-44b1-8714-38c356a65f42 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:41.481825 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:41.836816 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-dda182ce-5661-4c65-88ee-0042b4b6dc4b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:42.420181 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:44.165590 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:41:44.966092 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:41:56.529548 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:08.552503 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-d0a534ef-a3d0-4ce4-849c-203bd9910114 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:11.486432 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:11.838278 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-36ce96f2-8ab2-4b68-b8dc-17e8f5f4da7a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:12.424758 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:14.968078 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:21.164846 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:42:26.528857 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:38.554310 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a0ee3ae5-b25f-4628-9857-dc5604eab514 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:41.489762 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:41.840692 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-344f1566-341a-4212-b2dd-152ddb79c99d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:42.426239 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:44.974887 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:56.580545 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:42:58.165756 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:43:08.557172 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-470947d8-1465-4328-a3cd-512eb5f8f72f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:43:11.495233 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:43:11.842594 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5d7eabb8-2363-45cf-8c91-b3abcd4ef46f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:43:12.432639 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:43:14.973731 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:43:22.392129 dv-cinder-772623-6-iscsi neutron-server[91820]: DEBUG neutron.wsgi [req-cd6ba1e9-6375-44ae-b8f1-62d9ec328467 req-58041a73-a66a-4e5a-b580-ea037199e076 service neutron] (91820) timed out ('10.222.0.11', 57378) {{(pid=91820) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}}
May 27 09:43:26.558830 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:43:35.165355 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:43:38.560271 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-a3268b12-2d88-403c-92f5-0f066dc0c095 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:43:41.498963 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:43:41.846578 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-1b5b05e5-7440-4804-a87e-372fefd24fe6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:43:42.433866 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:43:44.978501 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:43:56.558681 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:08.562245 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e60be4de-a8d4-4d48-8b87-fa73c4948481 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:11.501595 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:11.850827 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-2cdb3d51-6de1-478b-b255-f0c076298d8e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:12.164134 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:44:12.435775 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:14.979527 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:26.558364 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:38.564140 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-bfeb0f74-9c85-4b05-bec8-dd10606f4e0b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:41.503685 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:41.851696 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e3605439-eedb-445a-a570-cdc3af1e6dc0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:42.439041 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:44.982283 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:44:49.163532 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:44:56.571323 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:45:08.565485 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-6ebf4abc-3b86-408e-b163-a9bf3c70e75f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:45:11.505813 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:45:11.854784 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-e65ecd9f-c322-4a6e-b631-2269f8419fdf None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:45:12.440713 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:45:14.984742 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:45:26.162392 dv-cinder-772623-6-iscsi neutron-server[91823]: DEBUG neutron.db.agents_db [None req-9bb06f81-75d6-4fd6-8a52-03d276d063d3 None None] Agent healthcheck: found 6 active agents {{(pid=91823) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}
May 27 09:45:26.571592 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-5c4b6e94-01e5-4ab2-bcff-4dfdc7014b40 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:45:38.566927 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-b2c7197f-8233-45e0-80a3-94e7e31e3452 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:45:41.508399 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-48c9c564-d61f-4d6f-8c8a-7eaad9d0384a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:45:41.856400 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-aa950755-929c-48fd-b9f9-b3da50d0821e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:45:42.444476 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-3ede0ae6-1cf5-41f8-a607-04633b153421 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}
May 27 09:45:44.986342 dv-cinder-772623-6-iscsi neutron-server[91822]: DEBUG neutron_lib.callbacks.manager [None req-76b2e45e-4f39-4f57-bf23-29360091bb79 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8739971585271', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-860091'] for agent, after_update {{(pid=91822) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}